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IRE TRANSACTIONS ON AUTOMATIC CONTROL 


This as the first issue of the PGAC TRANSACTIONS to have papers selected and arranged by a Guest Editor. 
For this work, we gratefully thank Dr. Robert Kramer of the M.I.T. Electronic Systems Laboratory. In addi- 
tion, this 1s the first regular issue of PGAC TRANSACTIONS to feature conference papers which have been 
subjected to a full review procedure. We hope that this policy can be continued and that it will meet with the 
approval of our members and others interested in automatic control.—The Editor 


Foreword 


The 1961 Joint Automatic Control Conference is the 
second conference on automatic control sponsored 
jointly by the AIChE, AIEE, ASME, IRE, and the 
ISA. This joint action by the five societies is an attempt 
to reduce the number of meetings on control systems 
and at the same time, hopefully, to improve on the 
quality of the papers. Judging from the interest gen- 
erated at the first meeting, the idea of a joint conference 
is meeting with general approval. As the mechanism for 
holding these meetings is refined with experience, their 
success should be even greater. 

At present, the publication of the papers presented at 
these conferences is the responsibility of the individual 
societies since, as yet, no combined proceedings has 
been agreed upon. For the first conference (1960),-the 
IRE-PGAC papers were reviewed and selected by a 
special program committee independent of the regular 
TRANSACTIONS review board. The large number of papers 
and the short time available for their review precluded 
any participation by the regular TRANSACTIONS review 
board. Since the selected papers were thus not of as- 
sured TRANSACTIONS quality, they were published in a 
special JACC Record issue of the TRANSACTIONS in pre- 
print format. 

This year, however, the procedure was modified in 
two important aspects. To ensure that the reviews of 
these JACC papers be up to the standards of the regular 
TRANSACTIONS papers, one of the three reviews given 
each of the papers submitted was by the regular PGAC 
TRANSACTIONS review board, under the direction of the 
regular PGAC Editor. The IRE Program Committee 
arranged to have two additional reviews of each paper. 
The selection of papers was made on the basis of all 
these reviews. In this way, the high standards of the 


_ TRANSACTIONS papers were injected into the selection 


ne 


of Conference papers, even though many new reviewers 
were pressed into service. 


In addition to this review change and partly because 
of it, decision was made to publish this year’s papers in 
a regular issue of the TRANSACTIONS. This, in effect, ac- 
cords these conference papers a status equal to those of 
the regular TRANSACTIONS, with fine letter-press print- 
ing and incorporating reviewers’ comments. Further- 
more, an attempt was made to have this issue ready 
for distribution at the Conference. Only you, the reader, 
will know the degree of our success in having our papers 
published concurrent with the Conference. 

Apropos of our attempt to gauge the success of a joint 
Conference, one good indication of the popularity of 
this Conference is the great amount of material sub- 
mitted for our consideration. We received no less than 
31 papers, despite the fact that there were only three 
months between the initial call for papers and the dead- 
line for submitting them. It was quite obvious that pro- 
gram limitations would preclude our presenting a great 
many of them, and, therefore, a considerable number 
had to be eliminated. This presented the Program 
Committee with a problem and a prize. The prob- 
lem was reviewing this large number of papers carefully 
and selecting the best; the prize, of course, is a poten- 
tially excellent group of papers. We finally accepted 16 
of the 31 submitted—an acceptance of 52 per cent— 
and we feel that the IRE-PGAC group of papers is of 
high quality. We sincerely hope that, rather than dis- 
couraging authors from submitting papers to the IRE 
because of the high rejection rate, this will encourage the 
submission of high-quality papers to a Conference of 
recognized high quality. 

In conclusion, we should like to express our personal 
thanks to all those who did the real work of reviewing 
and evaluating the articles which were submitted. 


—ROoBERT KRAMER, Guest Editor 
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The Issue in Brief 


On a Property of Optimal Controllers with Boundedness Constraints, 
H. L. Groginsky 


This paper deals with a theory for optimal control systems de- 
signed to operate a plant of known characteristics. It is assumed that 
only limited changes in the system characteristics can be effected by 
the control variables at the designer’s disposal. 

It is shown that within the assumed limitations for a wide class 
of inputs and systems and for a certain class of measures of the sys- 
tem performance, an optimal system behaves as a relay or switched 
system during the transient period and as a continuous system during 
periods in which the input is reproduced identically. A procedure is 
described for determining the switching times during the transient 
period in terms of the permissible measurements. 


A Minimal Time Discrete System, C. A. Desoer and J. Wing 


A sampled-data control system with a plant having real poles and 
limited input is considered. The plant forcing function which will 
bring the system to equilibrium in a minimum number of sampling 
periods is desired; this function is called an optimal strategy. 

To implement this particular optimal strategy, we define a sur- 
face in state space called the critical surface. It is shown that this 
optimal strategy will be generated by the following procedure: at the 
beginning of each sampling period, the distance ¢ from the state of the 
system to the critical surface is measured along a fixed specified di- 
rection; if ¢>1(or < —1), then the forcing function for that sampling 
period is +1 (or —1); if |¢| <1, then the forcing function is ¢. For a 
third-order plant, it is shown that the critical surface has certain 
properties which lead to a simple analog computer simulation. 


Theory and Design of High-Order Bang-Bang Control Systems, 
M. Athanassiades and O. J. M. Smith 


A complete analysis and design is presented of a nonlinear con- 
troller to minimize the response time of a limited input plant whose 
transfer function has N real roots. 

The design procedure is based exclusively on the concept of the 
switching hypersurface of the system in N-dimensional state space 
and on the concept of the “distance function” from the state point to 
the switching hypersurface. 

The linear and nonlinear transformations performed by a non- 
linear computer upon the error and its time derivatives, in order to 
generate the optimal amplitude limited input to the plant, are de- 
scribed in detail, and properties of the switching surfaces, which are 
subsets of the switching hypersurface, are also described. 


Model Feedback Applied to Flexible Booster Control, G. E. Tutt and 
W. K. Waymeyer 


The fundamental control problems in the design of flexible space 
vehicle boosters center around the control of an aerodynamically 
unstable airframe in a dynamic wind shear (jet stream) environment. 
This paper presents a feedback model approach to this design prob- 
lem which shows promise. This system does not adapt to body bend- 
ing, but instead is contrived to ignore it. 

A conventional attitude control system is assumed in which rigid 
body control considerations have been used to design the control 
loops. A model of the plant (airframe rigid body dynamics) is derived. 
The attitude and rate feedbacks are now syntheszied by a combina- 
tion of actual and model rate and attitude. Bending and similar 
dynamic effects are filtered from the actual attitude and rate signals 
as required, and the information thus rejected is supplied from the 
model of the plant. It is readily shown that the performance of this 
system in response to commands is substantially identical in all im- 
portant respects to the original rigid body system. 


Terminal Control System Applications, E. A. O’Hern and R. K. 
Smyth : 


This paper deals with certain theoretical extensions of earlier 
work on terminal control techniques and their application to an air- 


craft landing system. The case considered is of a system having a 
second-order response from altitude rate command to altitude rate. 
The terminal time equations for this case are developed together 
with the various closed-loop weighting functions by transform meth- 
ods. From the terminal equations developed, the terminal controller 
equations are synthesized for a two-condition terminal controller 
which controls altitude and altitude rate at the terminal (touchdown) 
time. The mechanization of these terminal controller equations are 
presented. 

The flight test results of the terminal control system using the 
system developed in this paper are described briefly. A comparison 
between flight test and simulation results is included. 


A Parameter-Perturbation Adaptive Control System, R. J. McGrath, 
V. Rajaraman, and V. C. Rideout 


Theoretical and simulator studies of some new forms of a param- 
eter perturbation self-adaptive system are presented in this paper. 
Here, the response of the control system is subtracted from that of a 
reference model to obtain the error signal. As in the previous studies, 
the controllable parameters of the system are sinusoidally perturbed. 
Somewhat different methods of processing the perturbation and error 
signals have been employed to obtain the parameter control signal 
which is used in the automatic optimization of the control system. 

Computer studies are made with both random and deterministic 
input signals and parameter disturbances. The results are compared 
with the analytical results. 


Transfer-Function Tracking and Adaptive Control Systems, C. N. 
Weygandt and N. N. Puri 


In an adaptive system in which the plant parameters are varying, 
it is necessary to track or measure the plant parameters. Two sepa- 
rate schemes are proposed for tracking the transfer function of a 
multi-order system. 

The first scheme is based on perturbing the normal process with 
small amplitude sinusoidal perturbation signal consisting of different 
frequencies. The tracking system is a closed-loop system. 

The second scheme does not depend upon perturbation signal, 
but does require knowledge of the form of the transfer function of the 
system. It is more suitable for tracking systems which have a number 
of first-order lag units connected in tandem. 


Adaptive Servo Tracking, A. I. Talkin 


This paper describes a self-adapted sampled-data radar tracking 
loop. The tracking loop may be considered to be a low-pass filter 
with a variable bandwidth. The loop is designed to adapt rapidly to 
changes in the input signal by monitoring both the apparent error 
and the loop output. : 

Results show a mean tracking error 25-34 per cent less than that 
of a comparable linear system, at a receiver SNR of 10 db. 


Precision of Impulse-Response Identification Based on Short, Normal 
Operating Records, R. B. Kerr and W. H. Surber, Jr. 


An identification scheme is presented for estimating in a short 
time the impulse response of a system from normal operating records. 

Maximum-likelihood estimates of the impulse response are dis- 
cussed, and a “sufficiency” criterion on the input signal is defined 
based upon the expected integrated squared difference between the 
actual and estimated impulse responses. Examples of sufficient and 
insufficient test signals are given in terms of a “sufficient record 
length” criterion. Experimental results illustrating this latter crite- 
rion are presented. 

The time variation of the system parameters sets an upper bound 
on the useful record length. Some preliminary results relating this 
time variation to the useful record length are also presented. 
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A Technique of Linear System Identification Using Correlating 
Filters, W. W. Lichtenberger 


Random signals and cross correlation can be used to determine 
the impulse response of a system. If, instead of arandom testing signal, 
one is employed which has certain properties similar to the random 
signal, a linear filter may be constructed which performs the neces- 
sary cross correlation. No multiplication is involved, and the output 
is a continuous function of time. Thus, a single filter obtains the im- 
pulse response for all values of time. A disadvantage of this method 
is that in a practical situation, there is usually a great amount of noise 
present. This “noise” consists mostly of process actuating signals 
since the measurements must be made “on line.” 


A Modified Lyapunov Method for Nonlinear Stability Analysis, 
D. R. Ingwerson 


The Lyapunoy stability criterion deals with arbitrarily small dis- 
turbances. A generalization of the original theorem which applies to 
arbitrarily large and arbitrarily small disturbances, and to interme- 
diate conditions as well, is given in this paper. 

In contrast to the success that has been achieved in advancing the 
theoretical concepts of stability by this method, little has been ac- 
complished in the way of formulating practical means for applying 
them to specific problems. A method which is easily applied to many 
of the systems encountered in automatic control and which has 
given good results for numerous examples is presented here. 


A Mean-Weighted Square-Error Criterion for Optimum Filtering of 
Nonstationary Random Processes, G. J. Murphy and K. Sahara 


A procedure for use in the design of a physically realizable time- 
invariant linear system for optimum filtering of a nonstationary 
random process in the presence of nonstationary random noise is pre- 
sented. The criterion used to measure system performance is a mean- 
weighted square error. 

It is shown that the use of this generalization of the mean square- 
error criterion leads to a generalization of the Wiener-Hopf integral 
equation. A technique for solving this modified Wiener-Hopf 
integral equation is presented, and the application of the theory is 
illustrated in an example of the optimum synthesis of a missile inter- 
ception system. 


A General Performance Index for Analytical Design of Contral 
Systems, Z. V. Rekasius 


A performance index which enables one to specify the desired re- 
sponse of the optimum system in terms of the differential equation 
describing the response of an ideal model is proposed. 

A simple straightforward procedure of calculating this perform- 
ance index is outlined in the paper. This procedure consists of solution 
of a set of linear algebraic equations. Simultaneous solution of these 
algebraic equations yields the value of performance index in terms of 
gain and time constants of the actual system. It is then a simple mat- 


The Issue in Brief OF. 


ter to calculate the numerical values of the free gain and time con- 
stant parameters for the optimum system (7.e., to minimize the per- 
formance index). The procedure of optimization is illustrated by 
means of an example of a third-order system. 


Stability of Servomechanisms with Friction and Stiction in the Out- 
put Element, P. K. Bohacek and F. B. Tuteur 


Servomechanisms with friction in the output element are often ob- 
served to oscillate, even though the Bode diagram indicates stability. 
This paper investigates the conditions for this instability and the 
type of oscillation that can occur. It finds that an overdamped sys- 
tem with a lag equalizer is stable if L<2C/C—1, where L is the lag 
ratio and C=static friction-++Coulomb friction; with a lag-lead equal- 
izer it is stable if 


L_« 
Sees (ones te 


where a/b is the ratio of the two zeros of the network. Experimental 
results that correlate with the theory are also included. 


Sensitivity Considerations for Time-Varying Sampled-Data Feed- 
back Systems, J. B. Cruz, Jr. 


A synthesis procedure for linear time-varying sampled-data feed- 
back systems is described. The plant and compensators are char- 
acterized by transmission matrices first introduced by Friedland. 
Part of the specification involves a deviation or error matrix for the 
time-varying plant and an allowable deviation matrix for the closed- 
loop system. Noise considerations are also included. Using a tech- 
nique analogous to that of Horowitz which was originally used for 
fixed multivariable continuous control systems, the digital com- 
pensator transmission matrices are derived. The corresponding time- 
varying digital compensators are realized by means of zero-order hold 
circuits, switches, resistors, and adders. An example using a digital 
computer simulation is included. 


Direct Cycle Nuclear Power Plant Stability Analysis, D. Buden and 
R. F. Miller 


A power plant with a heat exchanger such as a nuclear reactor 
substituted for the conventional chemical interburners in a jet engine 
will cause a considerable change in dynamic performance. The in- 
stantaneous power generated by the heat source is not the same as 
the instantaneous power delivered to the turbine. The basic control 
problems are analyzed using fixed control parameters and partial 
derivatives around a given operating point. A mathematical criterion 
is developed and correlated with power plant test data. 

An understanding of the inherent limitations of combining a re- 
actor, or any heat exchanger having a thermal lag, with a basic jet 
engine makes it possible to devise a means of control. The introduc- 
tion of an effective operational speed control makes it possible to 
operate a complete power plant under any desired condition. 
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On a Property of Optimal Controllers 


with Boundedness Constraints 


HERBERT L. GROGINSKYf, MEMBER, IRE 


Summary—This paper deals with a theory for optimal control 
systems designed to operate a plant of known characteristics. It is 
assumed that error-free measurement of the system input and the 
system behavior is permitted, but only limited changes in the system 
characteristics can be effected by the control variables at the de- 
signer’s disposal. 

It is shown that within this limitation for a wide class of inputs 
and systems, and for a certain class of measures of the system per- 
formance, an optimal system behaves as a relay or switched system 
during the transient period, and as a continuous system during peri- 
ods in which the input is produced identically. 

A procedure is described for determining the switching times 
during the transient period in terms of the permissible measure- 
ments. The result is the design of the optimal controller. Typically, 
its realization requires analog computation of the switching function 
and digital switching of the control variables. 

The design of a second-order regulator system, in which the con- 
trol variable is the gain in the feedback path, is obtained. Marked 
improvement in the system performance is noted. 


I. INTRODUCTION 
ale HE problem discussed in this paper is the follow- 


ing: 


1) given a basic system whose characteristics are 
completely known (its set of differential equations 
including parameters, adjustable parameters, and 
available forcing functions are specified), 

2) given any desired noise-free measurement up to 
the present of the system input and the perform- 
ance of the basic system, 

3) given a means of changing the performance of the 
basic system while it is in operation (note that 
only a limited amount of such control is available), 


how then can a controller be designed which automati- 
cally and continuously selects the values of the adjusta- 
ble parameters within the admissible range which opti- 
- mizes the over-all system performance on a wide class 
of inputs. 

In terms of a mathematical model, the problem is to 
find a set of functions Y[x(¢), 7] in which x is the total 
system state of the system (z.e., the internal state of the 
basic system plus the state variables describing the in- 
put) governed by? 


x(t) = g[x(r), Y(r)| 
x(t) = x, (1) 


* Received by the PGAC, November 14, 1961; revised manuscript 
received, March 10, 1961. The research was supported by the Elec- 
tronics Research Directorate of the AF Cambridge Research Center. 

+ Raytheon Co., Advanced Dev. Lab., Wayland, Mass. Formerly 
at Electronics Res. Labs., New York, N. Y. 

1 Unless otherwise noted, lower case letters denote scalars, bold- 
face letters denote vectors and upper case letters denote matrices. 


which minimizes 


t+T 
- if G(e(e))dr (2) 


t 
where 
Ee ax 


a A constant vector 


under the constraint that 
| ya(x, | < ki = fixed constant. (3) 


It is clear that the knowledge of Y asa function of the 
measurable quantities x is sufficient to specify com- 
pletely the design of the optimal controller. It is also 
clear from the formulation of the problem that only the 
present state of the system determines the present 
adjustment of the control variable so that storage of 
past state values is unnecessary. 

In this analysis, only the special case in which the 
adjustable parameters of the basic system enter the 
system (1) linearly is considered. In other words, al- 
though the basic system may contain nonlinearities, 
the system equations are to have the form 


x = (x) + VA(x). (4) 


The generic form of the systems under consideration 
is shown in Fig. 1. 


Il. PROPERTIES OF AN OPTIMAL CONTROLLER 
A. Summary 


The object of this section is to establish conditions 
under which an optimal adaptive controller sets the 
control variables to their extreme allowable values. This 
type of control function is called the switching mode. The 
primary function of the controller during such opera- 
tions consists of selecting the times at which the control 
variables are switched from one extreme to the other. 

Criteria of the form (2), in which G(e) is continuous 
and differentiable and monotonic in | e| , and inputs 
which are noisefree and bounded lead. to the need for the 
switching mode when the system is in transient opera- 
tion. The switching mode of operation terminates when 
the input can be reproduced identically, with the con- 
trol parameter within its prescribed bounds. However, 
if the system has entered its continuous mode, but the 
input cannot be reproduced identically throughout the 
entire interval of concern, the system must eventually 
revert to the switching mode. It is shown that the con- 
tinuous mode terminates when the system input can no 
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g(x), h(x) ARE 
POSSIBLY 
NONLINEAR 
OPERATORS 


Fig. 1—General form of linearly controlled basic system. 


longer be reproduced identically. Prior termination in 
anticipation of the switching mode cannot improve the 
performance of an optimal system. 

The simplest, most straightforward derivation of this 
result is obtained through the use of dynamic program- 
ming. However, because it is necessary to assume 
differentiability of the minimal loss function, a fact 
which is not known a priori, the derivation lacks rigor. 
The Euler-Lagrange method provides the rigorous treat- 
ment, and in addition resolves the problem of the onset 
of the switching mode. 

The solution obtained by dynamic programming is 
important because it provides a computational algo- 
rithm with which the design of the optimal controller 
can be obtained. 


B. A Theorem on Optimal Adaptwe Controllers 
Theorem: 


1) Let y(x, t) be a set of m control functions for a 
basic system which is linearly controlled, 7.e., the 
system governed by the set of equations 


x = g(x) + H(x)y; — x(0) = xo (5) 


where g(x), H(x) are sets of functions of class C’ 
tans 


2 A function of variables f(x) defined on an open region R be- 
longs to class C* in R if its first R partial derivatives exist and are 
continuous at every point xin R. 
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bo 
> 


Let e(¢)4 system error and the first p derivatives 
of € be such that 


rea) 
é = €1(x) 
<() = p(X): (6) 


3) Let Ge, €,---, e) be a function of class C} 
jointly in all its variables, having the properties 


that: 
a) G(e, é,---, e) =0 if and only if 
e=€=--- = M=0, 
b) dG > 0; e210 jel page 
de) <0; € <0 zi 


4) Let o(x) =G(e0(x), a(x), -- +, €p(x)) be such that 
g;H(x) = 0 (7) 


where 


Ope = ? | 


Oo 
ke 
5) Let Yopt(x, T) be a control function such that 


T 
ViGe Ihe {Yopt} ) = iim { G(e, €,---, €™)dt (8) 
0 


{y} 


under the additional constraint that each member 
of the set is bounded, 2.e., 


erent Sey ube pe Rivera OA Ze (9) 


6) Let at least one among e¢, €, ---, €® be different 
from zero at some time ¢ on the interval 0<i<7. 
Then at that time t the function Yopr(t) has the prop- 
erty that 


(10) 


| vyope | = “Ry fa Les eae Att. 


Before demonstrating the proof of this theorem a brief 
discussion of the meaning of the assumptions 1) through 
6) is given. Some of these will be further amplified in the 
derivations which follow. 


1) The system equation (4), corresponding to the sys- 
tem shown in Fig. 1, is first rewritten in a form 
which explicitly separates all of the independent 
control parameters. A general system may have a 
single parameter governing the interactions on a 
number of states. In other words, various members 
of Y in (4) may be equal, yi;=‘er. Eq. (5) shows 
only the m variables which can be varied by the 
controller; all other redundant variables are elimi- 
nated. In general there are far fewer control vari- 
ables than the number of system states. 
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2) The system error and its first p derivatives are 
assumed to be defined strictly by the state vari- 
ables, and none of these involve any control pa- 
rameter ;. 

3) The criterion function is a distance-measuring 
function in the sense that the value of the function 
is positive when the system error or any of its 
first p derivatives differ from the desired condition, 
namely, ¢;=0, 7=0, 1,---, p, and further, the 
value increases as the deviation of any one of the 
e;'s from zero increases. 

4) The control function is assumed to have no im- 
mediate effect on the system error or any of its p 
derivatives. This condition is an alternate expres- 
sion of the information in assumption 4). 

5) The function yop; is assumed to be an optimal 
control function satisfying boundedness con- 
straints. The fact that the bounds are symmetric 
about zero is unimportant. 

6) At time ¢ the system is assumed to be in a transient 
condition. 


Conclusion: At the time ¢ all parameters must be set 
to their extreme values. 

A credible proof of this theorem is offered first by the 
method of dynamic programming. 

Let 


(egus) Santi iea tie ya) 


{y} 


(11) 


with 


[va oSebpcs Gos Ay os 


where J, x are as defined previously. It is important to 
note that f is independent of y since, assuming a solution 
exists, given x and 7 the optimal control function Yopt 
is determined on the entire interval 0<t<7T. 

The technique of dynamic programming is used to 
determine a functional equation for f as follows. Writing 


fi oto = fete. €1, °° 
= f Sad if "o(x)dt 


= fi ocean + [ober + aye 


ts €,|dt 


and employing the principle of optimality,’ the func- 
tional equation ~ 


f(x, T) = {rnin} ' if Ogi Hela nes a) 


is obtained. In this equation |y’} represents the set of 
control functions on the initial interval 0<t<A. 


3R. Bellman, “Dynamic Programming,” Princeton University 
Press, Princeton, N. J., 1957. See especially chap. 9, pp. 245-267. 
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If the input r(¢), now considered to be one of the sys- 
tem states, has a piecewise continuus derivative,* and 
if the admissible control functions y likewise have piece- 
wise continuous derivatives then, first, the system trajec- 
tory x(t) is continuous,® and second, 


{ o(x)dt —— o(xo)A + o(A), (12) 


A-—0 


except possibly on a set of measure zero. 

Likewise, if the first partial derivatives of f with respect 
to each of its variables are continuous, then f(x(A), 7 —A) 
has the MacLaurin series expansion 


f{x(4), T — A) 


,dx(A) 


=x, 1) @ ao - jn) + o(A) 


dA (3) 


where 


and f, is the vector 


vy 


pat 

| 
of 

a 


n =n, + n; = number of system states 


-+ number of input states 


and ’ denotes the transposition operation. 

Under these assumptions the remainder terms are of 
order greater than A as indicated.° Since under the previ- 
ous assumptions the state variables have piecewise con- 
tinuous derivatives, the derivatives in (13) can be re- 
placed by their values at time t=0, as given by the sys- 
tem equation (5). This permits (13) to be written as 


ja), lA) 

= f(xo, T) + Aj fx’ (6(xo) + H(xo)yo) — fr} + (A), (14) 
where yo denotes the values of the control parameters 
at time 7. 

Combining (12) and (14) and passing to the limit as 


A tends to zero, the nonlinear partial differential equa- 
tion 


0 = min {o(x) + fe’ [g(x) + H(x)y] — fr} 


ve 


(15) 


“The function r(t) is said to be piecewise differentiable on the 
interval O<t<T if it is differentiable everywhere except for a set of 
measure zero, where it is permitted to have only finite discontinuities. 

5 E. A. Coddington and N. Levinson, “Theory of Ordinary Dif- 
ferential Equations,” McGraw-Hill Book Co., Inc., New York, N. Y., 
Chapud) pid. 1955. 

6 P. Franklin, “Treatise on Advanced Calculus,” John Wiley 
and Sons, Inc., New York N. Y., pp. 137-138; 1940. 
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is obtained. Note that whereas in (11), \y} is a class of 
admissible control functions, in (15) y is simply the set 
of values of the control parameters at time t=0. Note also 
that the knowledge of y at time t=0 as a function of the 
initial state xo and the interval length T gives all the 
information needed to specify y as a function of x and 
7’—t throughout the entire interval. Hence, (15) has 
been written for an arbitrary time ¢ in the interval, 
which means that yo has been replaced by y, xo by x, 
and T by Tt. 

Because f is the minimal loss function, it is not a func- 
tion of y, hence, the only terms in (15) which depend on 
y are linear in y. Since the values of y are bounded by 
k, the minimum in (15) is obtained by setting each of 
the variables to 


Pons kj sgn Do fe, hij(x) 5) = 1 


4=1 


(16)? 


°,™M,; 
that is, the values of y lie at the bounds except when 
W(x, T — 1) = — >> fe,(x, T — dhij(x) = 0. - (17) 
: 1=1 


The set of functions W;(x, 7—t) henceforth are called 
the switching functions. Geometrically, (17) can be said 
to describe the boundaries of the regions in the phase 
space in which the sign of the jth control variable is 
constant. 

Now if at any time W,(x, T—#) =0, 1.e., a boundary 
surface is reached, but any of the remaining terms in 
(15) are not zero, (15) remains in force as the determin- 
ing equation for the system and yj;opt can be selected 
arbitrarily. In particular, if o(x) #0 which amounts to 
G(e, é,---, €”) #0, the magnitude of the control 
parameters can be set to their respective bounds. As- 
sumption 2) states that G(e, €,---, €”))=0 implies 
that e=e= -- - =e) =0, hence, the result of the theo- 
rem is demonstrated. 

The result can be stated alternatively as follows: 


As long as the system output differs from the system 
input (1.e., the system is in the transient condition, 
namely at least one among «, €, €,- ~~: is different 
from zero), an optimal system of the form (5) uses 
relay or switched type control. 


The transient period terminates whenever the system 
error and all its derivatives are zero. This corresponds to 
the case in which all terms of (15) are zero. A sufficient 
condition for this to occur is that the system reproduce 
the input identically at time ¢, and furthermore repro- 
duce it identically throughout the remainder of the 
interval T—t, with the amount of control available, 7.e., 
y;<k;, j=1, +--+, m. At such a time the value of the 
control variable y; may not be at any extreme, nor 1s it 
arbitrary. In fact, the values to which y must be set at 


o/|z|; 20 
: E703 
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this time can be computed by setting the left-hand side 
of (6) to zero, and then solving this system of equations 
together with the system equation (5) simultaneously 
for the instantaneous parameter values. This type of 
operation henceforth is referred to as the continuous 
mode. 

It is to be noted that the demonstration given above 
is deficient because the assumption of the existence of a 
set of continuous first partial derivatives of the minimal 
loss function f cannot be justified a priori on the basis 
of the hypotheses of the theorem. Nonetheless the meth- 
od is extremely useful, primarily because it provides a 
practical computational algorithm for the evaluation of 
the switching functions through (16), as is described in 
subsequent sections. Fortunately, the conventional 
Euler-Lagrange technique can be employed to rigor- 
ously justify the conclusion of the theorem as is demon- 
strated in Appendix I. Indeed the latter is also useful 
in resolving the issue of when the switching mode begins 
when the system has previously been operating in the 
continuous mode. 

The point in question pertaining to the onset of the 
switching mode can be stated as follows. Suppose that 
an input to the system has been applied which can be 
reproduced identically on an initial interval 0O<t<h 
with | | <k;,j7=1, --+,mbut todo so on the interval 
ty <<t<T requires at least one of | y;| to exceed its bound 
k;. It is clear that in the interval 4 <t<T the controller 
operates in the switching mode, but it may be that the 
optimal controller would begin this mode of operation 
prior to #; in anticipation of the desired response. In 
other words, the question is whether there are any cir- 
cumstances under which it would prove profitable to 
deliberately introduce an error into the system at a 
time when the input can be reproduced identically in 
order to reduce errors which will occur at a future time. 
The general theorem stated above denies that this 
should be done. In Appendix I the proof of the theorem 
includes a detailed study of this condition, and it is 
shown that an optimal system does not begin switching 
prior to ty. 


C. A Second-Order System with a Single Variable Param- 
eter 


For the sake of explicitness a simple prototype system 
of the kind shown in Fig.2(a) is considered. The variable 
parameter is taken to be the gain in the feedback loop, 
so that the block diagram of the system is that shown 
in Fig. 2(b). 

The differential equations of this system are 


x1 = Xe. 

(18) 
where y designates the controllable parameter and the 
bound on y is | | <1. That is, the feedback can be 


varied from negative to positive feedback. 
Consider that the loss function is of the type defined 


te = — axe, — Byx1 + Br, 
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Fig. 2—(a) Typical second-order system. (b) Second-order system 
with variable feedback gain y. (c) Implementation of an optimum 
second-order system. 


in (2). Then let 


T 
i(%4, 02,0, 2) = min i Gle(t + 1) |dr (19) 
ty} 0 


where 
eff) ait) — r(Z). 


Checking the conditions of the theorem, it is seen 
that hypothesis 1) is satisfied by the system equation 
(18), hypothesis 2) is satisfied by the definition (20) 
and hypothesis 3) is satisfied by choosing an appropriate 
G. Hypothesis 4) is checked as follows. 


(20) 


o(x) = G(x: — 7) 
cee 


In (21) the input state has been ignored because the 
parameter y in no way affects the transmission of the 
input into the system. Thus, 


“vo[ 


(E 
which is the assertion of hypothesis 4). 
Thus it is concluded that when «#0 


— ) 


oz h(x): = 


AUTOMATIC CONTROL 


ll 


— sgn f,’h(x) 
son W(a1, 41,7, 1 — #) 


Vopt 


l 


(22) 


Sgn Xifzy 


derived from the nonlinear partial differential equation 


0 '=' min {G(6) + xof2, + (Br — ax, — BYX1) fey — fr}. 


M4 
In other words, an optimal controller for the system 
shown in Fig. 2(b) would generally use a relay transfer 
contact for the feedback gain element with a computer 
controlling the sense of the relay switching as shown on 
Fig. 2c): 
I1[. EXAMPLE OF A DESIGN OF A SECOND-ORDER 
REGULATOR SYSTEM 


A. Summary 


In this section, the basic system described in Section 
II-C and designed as an autonomous system previously ® 
is now designed for step inputs. The details of the cal- 
culations are much more involved even in this elemen- 
tary case. Because of the location of the control element 
in the basic system, the results of the autonomous case 
are not readily extended to this new condition. The de- 
sign of a particular system is accomplished with the aid 
of a digital computer. The results of the computer study 
show that the optimal switching functions tend asymp- 
totically to the straight line segments in the phase plane 
obtained previously. The realization of the system is 
described. The design procedure for an mth order sys- 
tem is also described. 


B. Description of the System 


The system to be designed in this section has been 
described in Section II-C. This system is to be used as 
a regulator, hence the input is a constant 7. The system 
is to respond optimally to disturbances from its equi- 
librium condition, which is the reproduction of 79 identi- 
cally. Equivalently the disturbances can be attributed 
to step changes in the input, so that the design is also 
appropriate for a system designed to follow discrete dis- 
placements. 

The criterion function is the integrated square error. 
In this case it is possible,for the basic system to repro- 
duce the steady input identically, as can be seen by 
examining the steady state behavior of the basic system 
with y=1. In fact if y=1, the infinite integral, (19) with 
T= © exists, which shows that there is a bound for the 
infinite integral. Thus a solution to the optimization 
problem exists. 

The problem posed in this section does not reduce 
directly to the autonomous case by translation of the 
coordinate in the phase space because of the location of 
the nonlinear control. To show this, consider the effect 
of translating x1 by ro. Let 


8H. L. Groginsky, “On the Design of Adaptive Systems,” 1958 
IRE NationaL CONVENTION REcorD, pt. 4, pp. 161-167. 
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41 = x3 + ro 
Kong, (23) 
Then substituting in (18), one obtains 
x3 = Xo 


%2 = — aXe — Byx; + Bly — 1)ro. (24) 


But this new system is also not autonomous as is readily 
observed. More generally, there is no pair of functions 
filro, a, B), fo(ro, a, 8) for which the substitutions 


Oy = fi 
v2 = U2+ fe 


v4 


reduce (24) to a form independent of ro. 


C. The Switching Function 


The rigorous procedure for evaluating the switching 
function is begun by evaluating the loss function for 
finite but small 7 under each choice of the control vari- 
able. These loss functions are then used to determine 
the switching function corresponding to this interval T 
through (19). 

In this case, as in the autonomous case, since the 
input can be reproduced identically in the steady state 
if y=1 at all times, the solution when 7=©& can be 
arrived at immediately. This is done by examining the 
region in the phase space in which y= 1 for all time, and 
(19) is +1 at all points on the system trajectory. 

Since the system is linear and autonomous with y=1, 
the loss function and the switching function for this 
case can be obtained immediately from the autonomous 
. case. The result is that 


(x1 — ie [a(x1 — ro) + x2]? 


25 
ae ad (25) 


aPC; Xo) = 


and 

oo) + aay = ro) 
a8 

The region R,°, in which the control variable is +1 


and no further changes in the switching function is 
required, is 


(26) 


ie AXA, x2) ae 


xo + a(x1 — ro) > 0; 


Ry = 4%, 2: Shea 8 (27) 
a2 + po(t1 — 70) > O 
where 
aor — 48 = Af 3G 
Oe eg es ap! 8 pee gry Ot ee 


Dele 2 
and is shown in Fig. 3(a) (next page). The latter line 
is obtained from the condition that the trajectory re- 
main in the R,° region for all time. ; 

The region R_ adjoining R,°, in which y= — Ls is found 
as follows. The points in the phase space not in Hier 


et ee 
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are considered. Among these, the set is selected which, 

if taken as the initial disturbances of the system, leads 

to trajectories terminating on the boundaries of R,° 

when y is fixed at —1. These points are the ~R! region 
We = { a4, Seeley — lo (T), vo he R,°} 

for some T < », (28) 


Now if y= —1 
x(t) = Cet + Dert + ro (29a) 
vot) = — p3Ce—™! + py + Dert, (29b) 
where 
x; + 179) — Xo 
po Nees (29) 
p3 + pa 
p3(%1 + ro) + x2 
Deyo ee (29d) 
p3 + ps 
and 
Vo? + 48 + a Vo? + 48 — a 
Psa 7 [oh 5 ‘ 


Examination of these equations shows that the potential 
~! region is the shaded area shown in Fig. 3(a). 

Now for any initial point in the potential ~R! region, 
the loss function is 


f(a, 2) = ii | [ro — a(t) ?dt + +f9[21(T1), x2(T)], (30) 
$ 


where 7) is the time needed to reach the boundary of 
+R° from the initial point «1, x. with y= —1., 

In principle, (29) and (25) may be substituted in (30) 
and from this the derivative ~f,,!(01, x2) can be calcu- 
lated. Analytically the process is extremely laborious for 
two reasons. First, the number of terms is large. Second, 
the calculation of the point of intersection of the trajec- 
tory with the boundary requires the solution of a 
transcendental equation. For example, if the intersec- 
tion is on the line «;=0, 7; must be determined from 


Ce-mm + Dent — ro = 0. (31) 


For these reasons the purely analytic solution of the 
problem is impractical, and the design must be ac- 
complished with the aid of a digital computer. 

Numerical calculations illustrating the procedure 
were performed for the system a=3, B=2. Eqs. (29a—d) 
were normalized to ro, and the analytic evaluation of 
the integral of (30) was obtained. The computer was 
programmed to calculate first the point at which the 
trajectory enters the R,° region. Once this was deter- 
mined, the integral was calculated from the formula 
obtained by the analytic integration, +f°[x1(T1), x2(Ti) | 
was calculated from (25), and finally —f![x1:, x2] was 
found by adding these two (30). 

The partial derivative ~f:,'(«1, x2) which is needed to 
compute the switching function was obtained as follows. 
The loss function was computed for a grid of values of 
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Fig. 3—(a) Location of region R,° and the potential region R’, (b) Location of regions R,°, R’, +R®. (c) Switching 
curves for second-order regulator system. (d-e) Typical responses of a second-order regulator system. 
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x1, X. in —R'. The partial derivative was then computed 
by taking the difference of the loss functions at adjacent 
points in the phase plane along lines of constant «1, i.e., 


1 
Bie, (i, X2) = 
A 


ms [Fi(a, v2 + Aare) — —F (a4; X2) |) 

Since only the sign of this quantity is important, the 
computer was not programmed to perform the division 
by Axe. In fact, the computer was programmed to search 
automatically along lines of constant «1; in ~R! until the 
sign of the partial derivative changed. The value of 
%1, X2 at that point was recorded and the process was 
then repeated for a new value of x. In this way the 
switching function shown in Fig. 3(c) was obtained. 

Using the definition given in (28), the region R! is 
that shown in Fig. 3(b). The shaded areas shown in 
Fig. 3(b) are the potential +R? regions, and it is neces- 
sary next to examine trajectories beginning in this re- 
gion and passing into Rt. 

At this point the analogy with the autonomous case 
is evident and useful. For very large initial disturbances, 
1.€., | x1 : >0, it is clear that the system must be- 
have just as if no input were applied. Thus for | xi], 
| x2 >0, the switching function must asymptotically be 
given by y=sgn xi(vx1+%2). The latter remark is con- 
firmed by examination of Fig. 3(c). This figure shows 
that the boundary of the R_'region approachesa straight 
line in the phase space for large x1, x2. The asymptotic 
slope of this line is found to be 3.75 +0.015. 

Thus it is reasonable to expect the line x1=0 to re- 
main a switching function and the boundary of the R_! 
region shown as the heavy line in Fig. 3(b) to be the 
other switching function for the regulator system. In 
other words, the phase plane is divided into the four 
areas designated R,, R_ corresponding to the sign of 
the control variable which is to be used when the system 
state is in these regions. The fact that this is indeed the 
optimal switching function was confirmed by program- 
ming the computer to calculate the loss function f, using 
this switching function for the control variable. Ac- 
cordingly, the sign of x:f,,(x1, x2) so calculated corre- 
sponded precisely to the sign of the control variable 
assumed in the region +R’, which was the only doubtful 
region. 

The technique described above, of assuming a form 
for the control function and then checking through (22) 
as to whether the assumption made of the sign of the 
control function in a particular region is justified, is a 
very useful computational procedure. 


Xe 


D. The Response of the Optimal System 


The realization of the switching function in a form 
which is independent of the amplitude of the input sig- 
nal can be accomplished in many ways. For example, 
the switching function shown in Fig. 3(b) can be ex- 
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pressed as 
y = sgn wg(m1, 2), (32) 
where 
2(t1, U2) 
3 
3.74u; + ug — —————— / Tas a UO 
Us 1 
Pee Biolog eres 
= §) 4 
Te 3S 
Sup —= 1) == 29; OS tH Sil (33) 
4.3(u, — 1)9-378 ‘ 
Z aN Olena ah 
iets sane (uy =F te, wy > 1 


and 


The expressions for g for u,<0, u.>1 are approxima- 
tions for the respective segments of the switching func- 
tion shown in Fig. 3(b). Fig. 3(c) shows a plot of these 
expressions in comparison to the computed values. The 
form of the approximate expressions was chosen to 
match the asymptotic conditions, the conditions for 
duz/du, along the switching function g(w1, u2)=0, so 
that there is almost a single change in sign of the func- 
tion along any straight line in the regions in which each 
is defined. The particular conditions are 


dus 
1) an = 3, (34) 
duy ui=0 
2) dur 
“ aS SSS 0) 35 
duy ui ( ) 
3) g(t, U2) —? 3.74, + U2 
U1, Uz—> + ©, (36) 


Condition 1) and the asymptotic condition completely 
specify € in the approximation 


a 
Uy, U2) = vuy + U2 — Ue < One] 
g(t 2 1 2 fires rary 1 (37) 
O —— 
3 atl 
However the form 
vé(u, — 1)® 
g3(s, U2) = et LY (Ue) tte 38) 


1+ &:(u, — 1)® 


satisfies (35), the asymptotic conditions and the mono- 
tonic property for all values of &, & in the ranges 0<&, 
and 0<&<1. The parameters &, & can then be chosen 
to obtain agreement at two points on the g; boundary 
segment. In particular these were g3(2, —5.74) =0, which 
determines £1, and g; (8.9, —36.0) =0, which then deter- 
mines &. The fit of (37) and (38) at the points obtained 
by the computer are compared in Table I. 
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TABLE I 
TABULATED VALUES OF THE OPTIMAL SWITCHING FUNCTION 


* 
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xX Xo X2 
—10.1 39.91 39.47 
— 9.1 36.16 354: 
— 8.1 32.41 32.06 
— 7.1 28.79 28.38 
— 6.1 25.04 24.66 
= 5.1 21.29 21.00 
— 4.1 17.54 eo 
— 3.1 13.91 13.69 
— 2.1 10.29 10.08 
— 1.1 6.66 6.58 
— 0.1 Sp lG 3.30 

1.9 — 5.19 — §.33 

2.9 — 9.44 — 9.34 

3.9 —13.31 —13.20 

4.9 —17.19 —17.05 

Sree) —21.06 —20.80 

6.9 —24.81 —24.62 

LD) —28.56 —28.43 

8.9 — 32.31 —32.22 

9.9 —35.94 —36.0 


* yo is the calculated value of the analytic approximation. 


Now to complete the design, it is necessary to enable 
g(u1, U2) to apply for all values of ro. This can be done 
very simply by writing 


g(x, a2) 


3.1401 - 42 — > X sgn ro < 0 


te 
1 + 0.329 log 


39 
0 < asgnro < | r0| Se 


= 13(%1 — ro) + x9; 
ro| x ro, [0-878 
| ro [0-378 ai 1.15 | ees ro [0-878 d 


x1 Sgn ro > | rol. 


ees a ro) +. Xe + 


Now the controller for the parameter y must deter- 
mine its sign continuously according to (32). To do so 
it is required first to determine the sign of x; and then 
the sign of g(x1, x2). To obtain the latter the inequality 
in (39) which applies at the point x1, x. must first be 
found and the sign of the corresponding equation must 
then be calculated. 

The response of the optimal system is obtained as a 
necessary part of the computer solution of the design 
problem. The method described in Section III-B re- 
quires the system trajectory to be computed in all por- 
tions of the phase space. For this purpose, the computer 
was programmed to use the switching function (32), 
and from this the system trajectories are determined. 

Fig. 3(d-e) show the typical response of the adapted 
system to various initial disturbances. These values 
were chosen in order to show the maximum number of 
changes of the parameter value y, and correspondingly 
the greatest improvement compared to the basic system 


May 


for initial points in various regions in the phase space. 

Inspection of the switching function shows that, re- 
gardless of the initial disturbance, the optimal system 
requires no more than four changes of the parameter 
value y. This number is obtained, e.g., for the case of 
ro>0, when x:>>0 and x2 is sufficiently negative. The 
response of the system under this condition is similar 
to that shown in Fig. 3(e). 


E. Higher-Order Systems with Single Parameter Control 


The procedure to determine the switching functions 
for finite J systems of order greater than two is de- 
scribed below. For nonautonomous systems, it is further 
assumed that the input can be characterized by a state 
so that the system equation (1) is applicable. 

The switching function for 7~ < ~ is time variable as 
well as state dependent, as mentioned in Section II-B. 
The rigorous procedure to determine it is carried out as 
follows. First the trajectories emanating from any point 
in the phase space ~ corresponding to y=+K and 
y=-—K are computed. Let xt(t; £) be the trajectory 
when y=+k, and x(t; &) be the trajectory when 
y= —k. Corresponding to xt(t, —), the loss function 


MET) =f olxraolat 
and 
61 =f obk-Gala 


and their derivatives *f;°(&, T), :°(€, T) can be com- 
puted. 
Now let +R°(T), ~R°(T) be defined as 


+RYT) 4 Ean fET A) 20 lor all eer 
“RCTY Sl Ee te, PAR SO toralt) <n 
Then clearly for any T if £R,°(T) and if xt(é; &) 
eR,°(T—t) for all O0<¢#<T, then sgn y(~, T)=+41, and 
in fact it remains at +1 throughout the remainder of 
the interval. In this way, the region in the phase space 
in which y= +K throughout the entire interval 7) can 
be found. Call this region R,°(7). The mathematical 
definition of the region is 
R(T) = {E: ERT) and xt; HeR WL — 2) 
for allO <i < Ty}. 
Similarly 
R(T) = {&: R(T) and x(t; HeR(T — 2) 
for allO <¢ < T}. 
Now let B,.°(7T) and B_°(T) be the boundaries of the 
regions R,1(7) and R_1(T), respectively. If the system 


trajectory begins at a point in the phase space in neither 
R,°(T) nor R(T), the parameter value y must switch 


oli: Bia 
ae 
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at least once in the interval T. To determine those 
points in phase space requiring just one change in the 
sign of y, the regions adjacent to Ry°(7) and R_°(T) are 
examined. 

Suppose the trajectory x-(¢; £) where feR,°(T), 
R_(T) be such that x-(7; &)eB,°(T—7r) for some r<T. 
The loss function for this combination of trajectories is 


-/(E, T) = { olx-(t; Dat + +f°[x-(r; ); T — 7] 


and from this the derivatives —f:'(€, T) can be com- 
puted. Defining 


Be te (£97 (se) > 0) forall T’ < 7} 


the region R_1(7) in which the sign of y is initially nega- 
tive and later switches to positive is 


R(T) = (8: RUT) x0; DRT — 1) 
for allO <t<7(T)}. 


The region R,1(7) adjacent to R_°(7), in which sgn y 
= +1 and which requires a single change of the param- 
eter value, can similarly be found. The procedure for 
determining the regions requiring more than one change 
of y can similarly be found with the aid of (16). In this 
way, the entire phase space can be mapped for any 
interval 7. 

The procedure described above is extremely laborious 
even for low-order systems with simple inputs, as-has 
been amply demonstrated previously. A computational 
procedure which in some ways is simpler than the above 
procedure is to employ the following recursion method. 

Assume any convenient value for the parameter y, for 
example, y=+K. Then, as above, compute the tra- 
jectory xt(t; &), the loss function f°(&, 7) for all points 
in the phase space & and for all T<T7. The function 
f(E, T)h(£) =0 is then taken as the switching function 
in the next approximation. Thus in the first approxima- 
tion, the function 


si bd ees 
is used, while in the second approximation 
yi(é, T) = — sen fe°(E, T) AC) 
is used. Iterating the procedure, a sequence of approxi- 
mations 


ye, T) = — sgn fer(, T)A(E) (40) 


n=0,1,°°° 


are obtained. 
The difference in the two procedures can be described 


as follows. In the first procedure, the optimal response is 
built up from the knowledge of the regions in the phase 
space requiring no switchings in the time 7, single 
switchings and so on until the phase space is completed. 
In the second method, the optimal switching function is 
approximated by an assumed f unction, defined through- 


/ 
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out the entire phase space, for all T<7 . The optimal 
switching function is then obtained as a sequence of 
approximations obtained successively frora the loss 
functions computed for the lower-order approximations. 
The latter takes no regard of the number of alternations 
of the sign of y. 

The loss functions obtained by the latter process are 
readily shown to be monotonic decreasing. Since the loss 
function is obtained by using the trajectory determined 
by the previous approximation, then 


potcrl —t) -{ o|x(r) |dr (41) 


where 
x(t) = g(x) + y"*(x, T — 7); 
x(0) =c Wat) doe, 


Differentiating (41) with respect to ¢, it is found that 
fn*1(x, T) satishes the partial differential equation 


gee ho X) tetas SCOn tay nal. 
Therefore 
fat) — for = (fo — fogs) + yh fertta(x) 
= nix" h(x) 
= fr Dra) Be) te iti fy te) 
pe ea) x PICO) (43) 


(42) 


But since y"*t! satisfies (40), and hence minimizes 
yf."h(x), the last term on the right hand side of (43) 


v(x, T) = (yr? — y")fnA(x) 


can never be positive, 7.e., W(x, T) <0. 
Rewriting (43) as 


Pe ae ek (Savon) 
and comparing this to (42), it is clear that f+! —f” satis- 
fles 
T 
prc, 1) —(C, 7) = f vbeG), 7 - rer, 


where 
x(7) = g(x) 
x(0) = C. 


Since Y <0 throughout the entire phase space, it fol- 


lows that 
bees T) Sot (x, T) n = 0, Ai fae 


which establishes the monotonic property of the suc- 
cessive approximations. 
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APPENDIX | 


NECESSARY AND SUFFICIENT CONDITIONS FOR THE 
ONSET OF THE SWITCHING MODE 


The Lagrange method. 

Let 6x and dy be the variations of the state variables 
x and the control parameter set y, respectively. These 
variations are the vectors 


bV1 


6 Xn oy m 


Then the variation of the loss function J is given by 


F 
oJ ={ ox’ Oxdt, 
0 


where o, 1s the vector derivative of o given by 


a 
| 


and superscript ’ indicates transposition. 

Notice that because of the constraints of the prob- 
lem, not all the variations 6x and éy are arbitrary. In 
fact, only the éy variations are arbitrary since having 
chosen a particular set dy, the variations 6x are deter- 
mined through the system equations (5). A differential 
equation relating the variations can be obtained from 
(5) using hypothesis 1 of the theorem, namely that g 
and ;h of the system equation written in the form 


(44) 


t= a) + Daw (45) 


are C! with respect to each component of the state x, 
and assuming the variations dy are small. The system 
of equations is 


dx = Adx + >> ;hdy,, 


j=1 


(46) 


where A is the m Xn matrix given by 


A= & + Dy jhsy; 


j=l 


and 


|e 

l| 
Pera 
Q@}| @Q 
0 os 
ies 
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| One | 
In (46) higher-order variations have been neglected so 
that A contains only known time functions; that is, in 
taking variations, the optimizing solutions for the state 
x and the parameter set y are assumed known and these 
solutions are perturbed by the variations 6x and dy. 
Under these assumptions, neglecting higher-order varia- 
tions amounts to assuming a complete knowledge of A 
on the interval 0<t<T-. Similarly, ;h, would also be a 
set of known time functions on this interval. 

Under these assumptions the differential equation 
(47) is a linear set whose solution can be described ex- 
plicitly by well-known conventional methods.?® In fact if 
Y(t) is the solution of the matrix differential equation 


(47) 


May 


and similarly 


Dx On We 


V(t) = AY) 


with the initial condition Y(0)=J, where J is the iden- 
tity matrix, then the solution of (47) can be written as 
t 


Y(t) Y-(z). ;h(7) 6y;(7) dr, 


0 


dx = V@c+ >> (48) 
Fa 

where c is the initial condition of 6x. Since all admissible 

solutions meet the boundary condition x(0) =x, it fol- 

lows that 6x(0)=0, hence c=0. Thus the solution of 

(47) meeting the proper boundary condition is 


m t 


ix = >> 


j=1 


Y(t) Y—\(r) ;h(7)6y;(7) dr. (49) 
The variation 6/ can now be written entirely in terms 


of the independent arbitrary variations 6y by substitut- 
ing (49) in (44). This yields 


rf > if ap ox! () VQ) V(r) s(x) by,(r) drt. 


Finally, interchanging the order of integration and also 
the variables ¢ and 7 enables the equation to be written 
in terms of the solution on the latter part of the interval 
and further places the variations éy; as a multiplying 
factor in the last indicated integration, as follows: 


m 


wh = aa i} ox'(r) V(r) Y-l(t) ;A(d)by,(t)drdt. 


Now consider that at some time ¢, the optimal value of 
the parameter 4; is k;. In order that the perturbed system 
Viopt + 69; =k; +6y,; satisfy the boundedness constraint, 
the variation 6y; can only be negative. (dy; is always 
sufficiently small so that the lower bound is also not ex- 
ceeded.) Similarly if y; op:= —k;, then only positive vari- 
ations for 6y; are admissible. If y; opis within the bound, 
the variation can be arbitrary. 


® Coddington and Levinson, op. cit., chap. 2. 
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Since perturbing an optimal solution can never de- 
crease 6J, it follows that 6J>0 for all admissible varia- 
tions. In particular, when y; is at the bound, the in- 
equality may hold. However, when y; is within the 
bound, the equality must hold. Taking these permissible 
variations into account then, it is necessary that 


: <0; y(t)=k (50a) 
{ ox (r) V(r) Y(t) sh()dr} = 0; | y,(t)| <; (50b) 
>0;  y,(t) = — Rk; (50c) 


under the conditions listed. 

The next step in the proof consists of obtaining equa- 
tions describing the types of systems, the types of cri- 
teria o and the conditions under which these systems 
and criteria make the equality relation above hold. 
Since Y(r) requires complete knowledge of y on the 
interval 0<7<7, (50) are not useful in themselves in 
determining the switching conditions. Because of the 
inequalities, the necessary conditions which define the 
times at which switching occurs cannot be expressed 
directly in terms of the known functions A, ;h and o. 
Nonetheless, (50b) can be used to determine the condi- 
tions for the onset of the switching mode as indicated 
next. 

Consider that | y,(2) | <k; on some time interval. Then 
not only is (50b) valid, but it also possesses a derivative 
with respect to ¢. Let 


d Id 
z(t) =f ox (7) V(r) Ya) dr. (51) 
t 
Then 
T 
z'(t) = — o;'(t) +f ox (rt) V(r) Y(t) dr. 
t 
Since?® 
Y-(1) = — YVY-, 
substituting (47) in this equation results in 
YY) = — YA. 
Hence 
T 
Bei lis ff ol (t) V(t) YU) A (Oar 
t 
From the definition (51), it follows that 
Zz’ = —o, —2'A. (52) 


Thus z is the solution of the set of differential equations 
Zz ie A'z ty 


with the boundary condition 2(7) —9. 
In terms of the vector z, (50b) can be expressed as 


z! jh — 0. (53) 


‘10 Coddington and Levinson, of. cit., ch. 2, p. 70. 
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Differentiating the above equation with respect to ¢ 
yields 


zj;h+2' ;h=0 
and substituting (52) in this equation results in 
oz jh = 2'Gh — A ;h). 
Now 
Ox rte Os 


if the parameter control has no immediate effect on the 
state components measured by a. This means that if x; 
is an argument of o, then *; is independent of y,. If 
g is a measure of the first p derivatives of the system 
error, the condition is satisfied if the +1 error deriva- 
tive is independent of y;. The condition (54) is then 
exactly the same as that stated in hypothesis 2, which 
was used previously in the dynamic programming der- 
ivation to establish the need for a switching mode. 

It follows then that for the systems considered, the 
necessary condition in a region in which | | <k; is that 


z'(;h — A ;h) = 0. (55) 
In other words, an optimal system produces a parameter 
value y; smaller in magnitude than k; at those values of 
the state x satisfying both (53) and (54). 

Now (55) is satisfied if either 


Zon) 


(56) 
of if 


jh = A,h+ m, (57) 


where m is any vector orthogonal to z. 

Consider now the condition (56). Evidently if (56) is 
satisfied, so is (53). Since Y(t) and Y~1(#) are never singu- 
lar matrices,'! using the definition (51) in (56) gives the 
necessary condition as 


T 
{p ox’ V(r)dr = 0. 
t 


It is important to note that (58) applies for any 
j=1,-++-:,m of the control variables y. It will now be 
shown that the condition (57) yields exactly the same 
relation, so that (58) serves to define the region in which 
the parameter values need not lie on their respective 
bounds. 

Eq. (57) is exactly the same as (46) with ;A replacing 
x and m replacing 


(58) 


D, #hy;. 
jai 
Hence, from (47) it is clear that 
(59) 


ia (Cia [ vo Y—1(r)m(r)dr, 


1 Coddington and Levinson, op. cit., ch. 2, pp. 69-71. 
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where c is a constant vector. Since any solution of (57) 
must satisfy (55), the vector c is arbitrary. Thus sub- 
stituting (59) and (51) in (53) leads to 


f er 
at f : i von) Vale yV Lee eae erica = 09k 60) 


But (60) must be true for an arbitrary vector c. Hence 
(60) is satisfied if and only if each member of the left 
hand side of (60) is itself zero. Thus condition (57) is 
exactly the same as (58). Note that no new conditions 
are obtained from the second member of (60) since one 
of its factors yields (58). 

The existence of a region in which the parameter 
value is continuously varied is now defined by those 
regions in which (58) is satisfied. Consider now that (58) 
is met at time ¢. Then (58) can be written as 


T t+ T 
{ ox’ V(r)dr = if ox’ Vdr +f op aT = Oan(61) 
t t tA 


For sufficiently small A, the system remains in the con- 
tinuous mode region. It follows that 


T 
{ ox’ Ydr = 0 (62) 
t+A 
.whereas 
t+A 
{ ox’ Vdr —— o,' V(t)A. (63) 
t A~90 


Since Y(t) is never singular, substituting (62) and (63) 
in (61) shows that the necessary condition 1s 


(64) 


c= 0 


on the interval. Since the vector o, must be the null 
vector, the derivatives of the measurement function with 
respect to each state component must be separately set to 
zero. 

In particular, suppose the system error can be ex- 
pressed in terms of x as €=a’x where a is a constant 
vector. Then if the loss function is a measure of the 
error alone, 1.e., has the form (2), namely 


Ws = f ciou, 
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then 
Wes) = (Geen 


It follows that 


dG(e) 
ox = a. 
de 
The requirement (54) that 
ox’ sh = 0, i ech pede OF (7 (54) 
for all x simply means that a’;h=0, j=1,---, m. In 


other words, the control functions y exert only differen- 
tial control on the system output. Note that 


é=a’x = a'(¢ = > Ay) 
j=l 
= a's 


so that the first derivative of the error is continuous, 
even where the y,’s are discontinuous. 

The necessary (and sufficient) condition, namely 
o,=0, means in this case that dG(e)/de=0. If G(e) isa 
positive definite monotonic increasing function of the 
magnitude of € of class C', it follows that e=0 every- 
where in the interval in which (64) applies. Hence, dur- 
ing this interval, the output reproduces the system input 
identically. 

In this section it has been shown that periods in 
which the control parameters y may have values within 
their respective limits may exist. But once such a period 
is entered, it is terminated only when the input can no 
longer be reproduced identically with the control param- 
eter within their prescribed limits. This means that, 
even though it was known a priori that the input could 
be reproduced identically only on the interval 0<r7 
=t,<7T, and to do so on the interval t:;<7r<T would 
require the magnitude of at least one among the control 
parameters y to exceed its bound, an optimal system 
would not begin its switching mode of operation prior 
to time f1. 
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A Minimal Time Discrete System" 


C. A. DESOER{, sENIOR MEMBER, IRE, AND J. WING?, MEMBER, IRE 


Summary—Consider a sampled-data control system with the 
following sequence of components in the forward path: a sampler 
with period 7, a zero-order hold circuit, a linear amplifier with satu- 
ration limits +1, and a plant with transfer function 


It is assumed that the poles Xi, do, - - - , Xn of G(s) are real, distinct, 
and non-positive (a single integral is permissible). The sampler, zero- 
order hold, and saturating amplifier constrain f(1), the forcing func- 
tion of G(s), to be piecewise constant with values between —1 and 
+1. The forcing function f(t) is completely defined, for t>0, by the 
sequence of numbers fi, f2, - - - , where f; is the value of f(¢) during 
the 7’th sampling period. 

The minimal time regulator problem for the above system can 
then be stated as follows: Given G(s) with an arbitrary set of initial 


Bess 
conditions |[i.e., the state vector c(0) defined by its components 
c(0), (0), - - - , c™- (0) ]; find the forcing function f(t) [specified by 
fi, fo - - - and satisfying | fi| <1], and the corresponding computer 
in the feedback loop which will bring the system to equilibrium in the 
minimum number of sampling periods. Any such forcing function will 
be called an optimal control. a 

The first step is to consider Ry’ the set of all initial states c(0) 
from which the origin can be reached in N sampling periods or less. 
From this definition all such states are characterized algebraically 
and geometrically: Ry’ is shown to be a convex polyhedron with 


vertices. — 

Let Ry be the set of all initial states c(0) from which the origin 
can be reached in N sampling periods and no less. Each point of Ry 
is shown to have a unique canonical representation. The coefficients 
appearing in the canonical representation suggest an optimal control. 

To obtain this particular optimal control we define a surface in 
state space called the critical surface. It is shown that this optimal 
control will be generated by the following procedure: at the begin- 
ning of each sampling period the distance ¢ from the state of the sys- 
tem to the critical surface is measured along a fixed specified direc- 
tion; if ¢>1 (or <—1) then the forcing function for that sampling 
period is +1 (or —1); if | b| <1, then the forcing function is ¢. For 
a third-order plant it is shown that the critical surface has certain 
properties which lead to a simple analog computer simulation. 


I. INTRODUCTION 


been given to the problem of optimal control sys- 
tems, especially for the continuous case [1 |-[9]. In 
these problems, the key aspect is that the control signals 
are restricted to belong to a closed and bounded set; in 
the case of a single control signal wu it is restricted by the 
condition | u(t) | <v¥y where y is a prescribed number that 


[: recent years a considerable amount of work has 
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1521. 


plays a pre-eminent role in the design. The case of dis- 
crete systems has received less attention [10], [11]. 

This paper considers the following sampled-data con- 
trol system: The forward path consists of a sampler 
with period 7’, a zero-order hold circuit, a linear ampli- 
fier and a plant with transfer function 


1 
G(s) = = 


nr 


IT  -a,) 


aI 


The poles of G(s) must be real, distinct, and nonpositive. 
Thus, a single integrator is permissible. The control sig- 
nal f(t) applied to the sampler is restricted by | f(t) | <1: 
The problem is: Given an arbitrary set of initial condi- 
tions, find the forcing function f(t), satisfying |#@)| =< 45 
and the corresponding computer to be placed in the feed- 
back loop which will bring the system to equilibrium in 
the minimum number of sampling periods. 

The principal purpose of this paper is to establish 
carefully the optimality of the proposed control function 
and to indicate how a computer can be built to generate 
this optimal control function. 

In Section II the problem is carefully stated and then 
formulated in new variables so that the analysis in the 
remainder of the paper is as simple as possible. The 
principal result of this section is (8), which is the state 
transition equation of the system. In Section III, the 
set Ry’ is defined as the set of all states from which the 
origin can be reached in N sampling periods or less. In 
equation form, Ry’ is given by (12). From (12) a set of 
vertex points Vy is defined. It is then shown that Ry’ is 
the convex hull of Vy; hence Ry’ is a convex polyhedron. 
Finally a procedure is obtained for writing down all the 
points of Vw (Corollary 2). Next the set Ry is defined 
as the set of all states from which the origin can be 
reached in N sampling periods and no less. A unique 
canonical representation is then given for all points of 
Ry [see (17) and (18) ]. In Section IV the critical surface 
is defined. This surface plays, in the generation of the 
optimal control, a role which is similar but not identical 
to that of the switching surface in the continuous case. 
Finally, in Section V the method for generating an 
optimal control is established. It is as follows: 

Let y be the state of the system at the beginning of 
the present sampling period. Let ¢ be the distance be- 
tween y and the critical surface measured in the direc- 
tion of r; and using the length of ri as the unit length. 
The optimal control is then sat(#).! Section VI shows, 
by using two properties of the critical surface, that a 


1 sat (x) =x if |x| <1 and=«x/|x| when |x| >1. 
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conceptually simple analog computer using standard 
analog computer techniques can be constructed to gen- 
erate the proposed optimal control function. Finally, a 
numerical example is given to illustrate the fact that 
the canonical representation of Ry is just the sequence 
generated by the analog computer. 


ZERO- ORDER 
HOLD CIRCUIT 


SATURATING 
AMPLIFIER 


GOMPUTOR 


Fig. 1—Block diagram of servomechanism. 


Il. STATEMENT OF THE PROBLEM 


Fig. 1 shows the servomechanism that will be con- 
sidered throughout the paper. The plant is character- 
ized by the stable transfer function G(s). We assume 
that the poles di, Av, - > -, An of G(s) are real, distinct 
and nonpositive, 1.e., one of them may be zero. The ac- 
tual forcing function f(t), which is the output of the 
saturating amplifier, must at all times satisfy 


woes: (1) 


The sampler and the zero-order hold circuit require that 
f(t) be piecewise constant: f(t) =f, for (R—1)T <t<kT, 
(k=1, 2,---). Therefore, (1) becomes 


|e) oes NUNS (as egy eae (2) 


The forcing function f(t) is completely defined, for t>0, 
by the sequence of numbers fi, fo, >: -. 

The problem which we propose to solve is the follow- 
ing: Assuming that the input r(t) is zero at all times and 
given an arbitrary set of initial conditions 
[c(0), €(0), - - - , c*(0) | find the forcing function f(t), 
[specified by fi, fo, - - - and satisfying (2) | and the cor- 
responding computer which will bring the system to 
equilibrium in the minimum number of sampling pe- 
riods. 

As an initial step in the solution of this problem, the 
state transition matrix equation for a sampling period 
of T will now be derived. Let c(t) be the column vector 
whose components are c(t), c(#é),-- +, e*-Y(#). Let 
the denominator of G(s) be s*—@,1s""!— - ++ —as 
—d. The differential equation of the system can be 
written in the standard matrix form 


c(t) = Bce(t)+fra for (R-—1)T <i < kT 
Whee ee nee eG, (3) 


where 


= SS k= 
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The eigenvalues of B are the roots of the denominator 
of G(s) and will be assumed to be ordered as follows: 


Af <a eee rer A, ee Oe (4) 
The solution of (3) for a sampled system of period T is 


cy = eBloy_4 =e) (k = A 2, mee ) (5) 


where 


c, =state of the system at time t=kT, 

f;x=forcing function during the kth sampling period, 
(k=1)T <i<eki, 

b=(I—e*")B-la.? 


Observe that 1) the eigenvalues of e?” are 
adalat Chee We ater one ot 


with. eigenvector .u;=col(1, Ay Aso ee ee 
2) these eigenvectors constitute a basis for the state 
space, hence det(ui, uo, ---, un) #0. To simplify the 
algebra required by the use of (5), use the eigenvectors 
u; as a basis, thus 


nm 
Ca »s Via; 
i=1 


or 
c, = Uy, where Na = col (Yet, Viet S 5 Yin) (6) 
where the transformation matrix U has wm, us, --- , Un 
as columns. Similarly, 
ja SS d;u; 
t=1 
or 
b= U"'d d= col (di, dz, -- , dn). eb 


With the transformation of variables given by (6), (5) 
becomes 


pg. nae AYK-1 “= tna, (8) 
where [13] 


A=diag (exp 7, exp AeT, > - +, expAnTZ), 

vy. =state of the system at time t=kT, 1.e., at the 
end of kth sampling period (k—1)T<t<kT, 

fx =forcing function during the kth sampling pe- 
riod. 


Eq. (8) is the desired transition matrix equation which 
will be utilized in the remainder of the paper: it gives 
the state of the system at the end of the kth sampling 
period (y;) in terms of the state at the beginning of the 
kth sampling period (y,-1) and the forcing function 
(fx) for the duration of the kth sampling period. 


_ * It must be stressed that the matrix eBT is equal to a polynomial 
in B of degree (n—1). (See [13], p. 121.) 
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For the system under consideration it is easily verified 
that the conditions of controllability [12] are satisfied: 
the n vectors Bra, (k=0, 1, 2, +--+, n—1) are linearly 
independent. These conditions are equivalent to requir- 
meeAtd s(k=0. ie? -, nm—1) to be linearly inde- 
pendent, z.e., d;40 Gai =I 72)) 


Ie igs. 
III, CHARACTERIZATION OF Ry’ 
A. Definition of Ry’ 


Ry’ is defined as the set of all states from which the 
origin can be reached in N sampling periods or less. 
That is, for every point yo in Ry’ there is a sequence of 


forcing functions, fi, fe, - - + , satisfying (2), which will 
make yy=0. With these forcing function and using (8), 
a0) = fiA'd — fod ?d Saeed? Wes fyvA Nd (9) 


with | fi <1, +=1, 2,---, N. For convenience, the 
following notation is introduced: 


BAe) fh a1 P2034: - ); (10) 
and (9) becomes 
N 
= > firs with | fi <1 (@= 1,2, NV} (11) 
t=1 


Thus one can state compactly an equivalent definition 
of Ry’ as follows: 
Ry’ =S 


N 
rly = Dofire [fe] St, ¢=1,2,-+ 50h aa) 
i=1 


B. Properties of the Vectors rp 


Before proceeding to the complete characterization of 
Ry’, let us indicate three properties of the vectors ry. 

Property 1: For any set of distinct indexes 41, 12, + + +, %n, 
the vectors ri,, ri,, °° * , Ti, are linearly independent. 

Property 2: Consider n arbitrary indexes such that 


Oy Se St <a, <x N + 1, 


Then 
a) the &,, satisfying the equality 


n 
ei) Sata 
k=1 


are uniquely determined; 
b) sgn ban = Sri 
c) sgn £o,,,= —sgn fa, (k=1 


Another way of expressing facts b) and c) is to say that 
the sequence {Ea,} is of alternating sign and &,, is posi- 
tive, or equivalently that the sequence {£.,} of n ele- 
ments has m—1 sign variations. 

- Property 3: If, for some arbitrary integer k, 


k : 
ae Esto; = 0, 


i=1 


n—1). 


where 11<2< ---: <v:, then the sequence {é:} has at 
_ least ” sign variations. 
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These three properties are proved in Appendix I. 
They constitute the key to the characterization of Ry’ 
and, consequently, to the determination of the optimal 
control. 


C. Definition of the Convex Hull of Vy, C(Vy) 


Going back to the characterization of Ry’, let us ob- 
serve the obvious: 


Rien y wrens een 1} 3 
Reet lye nich ire fol Slee 
Ri = (yy = fir — fore J ect ales 
biter lgere= ot Wace tn Peet) 


Ry is a line segment parallel to 2r;, centered at the 
origin. R,’ is a parallelogram centered on the origin and 
whose edges are parallel to 2r, 2r2. Ry,’ is an n-dimen- 
sional parallelepiped centered on the origin, whose edges 
are parallel to 2ri, 2re, - - - , 2r,. For the case considered 
in the numerical example (Section VII), the regions 
Ry’ to Ry’ are illustrated by Figs. 11 to 13. 

To characterize Ry’, when N>42, is slightly more 
complicated and requires a little background. For this 
purpose, the set Vy is introduced and is defined, for all 
N>vn, as follows: 

Vy is the set of points in 1 space of the form 


N 
Ds ET i, 
=i 


(14) 


where: 1) each e; is equal to 1 in absolute value; 2) the 
sequence {e;} =(€, €, °° -, €v) consists of at most n 
subsequences of consecutive e,;s that have the same 
sign and each subsequence has a sign opposite to that 
of the preceding one and of the following one. (Equiva- 
lently, the e-sequence cannot Dane more than n—1 sign 
variations. ) 

For the cases n=3 and N=4, the e-sequences are 
illustrated in Fig. 2: when e;= +1, a square block of 
height +1 is drawn, It is easy to check that in space, 


Vy has 
n/N —1 
2 (aa 


points; obviously, this number increases much faster 
than N. Observe also that when N=n, Vy consists of 
2” points: the e-sequences are the 2” possible n-tuples 
of +1 and —1. 

A new idea must now be introduced: the concept of 
convex hull. By definition, C(Vy), the convex hull of Vx 
[14], is the smallest convex set containing Vy; or equiv- 
alently, if x1, x2,---, x, (ry arbitrary) are the points 
of Vy, then 


si 
2 Cs DE MiX; 


i=1 


S14 


oA 


Fig. 2—Complete listing of the e sequences of V, for n=3. 


is a point of C(Vyw), provided 


1) Mi 2 0, 2) 


ees Dee = il. 
7— 
Physically, the convex hull of Vy, C(Vw), is the set of 
all points x which are the centers of gravity of the points 
x; of Vy when x; is assigned any mass mu; obeying 1) 
emaval Ba 

A basic property of convex hulls that will be used is 
the following [14]. 

Every point y of C(Vy) is representable in the form 


ve Mya epee, w= 1 


1=0 1=0 


(15) 


where the y,’s belong to Vy but the selection of the y,’s 
depends on y. 

If y is a boundary point one may take wo=0.' For 
example, in 3-space, a cube is the convex hull of the set 
of its vertices, hence any point in the cube is the center 
of gravity of 4 appropriately chosen vertices; any point 
on the boundary is the center of gravity of 3 appropri- 
ately chosen vertices. Let us introduce, parenthetically, 
a fact which will help the visualization of later results. 
First, a definition [14]: a point x of C(Vy) is a vertex 
point (or extreme point) if there are no points x: and x» 
of C(Vy) with x14xs, with the property that x=ux 
+(1—p)xe for some p, O<p<i1. 

From this definition and the definition of C( Vy) and 
Vy it is easily verified that: 


all points of V» are vertices of C(V,.). (16) 


It should be stressed that this property is not true for 
larger values of N, and that this is the main reason why 
the characterization of the vertices of Ry’ is not easy. 


D. Fundamental Theorem and Classification of the Points 
of Vy 
The characterization of Ry’ is completed by (13) and 


the following theorem: 
Theorem 1: Let Vy be the set of points defined by (14), 


3 By definition, a point p is a boundary point of a set S if every 
deleted neighborhood of p contains a point p’CS anda point p’GS 
[14]. 
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and let C(Vy) be the convex hull of the set Vy; then 
Ry = CCV x) formal Viz na 

The proof is by induction and is given in detail in 
Appendix II. Note that from what has already been 
said (13), R,’=G(V,), te. the theorem  is™ irue stor 
N=n. The induction assumption is Ry’=C(Vy), from 
which one proves that Rwy! =C(Vw41). The proof is 
based on an idea which consists in classifying the points 
of Vy. 

Let 6 be any positive number small enough so that 
the 7,’s defined by the expansion 


n 
ty+1 = > Hila; 


1=1 


Oem Oy ON 


<1 for.all 7 and for all pos- 
, Gn. The classification of the 


satisfy the inequality | Oni 
sible choices of @1, do, --- 
points of Vy is as follows: 


Vyt contains all the points p; of Vy such that 
pitdbryyEC(Vy) but pi—dbrnyieG C( Vy); 

Vy contains all the points ‘q; of Vw such that 
qi—Srnyi€C(Vy) but qitd6ryy1CC(Vy); 

Vy> contains all the points b; of Vw such that 
b;=6ryi1EC( Vy) and b;+6rnarEC(Vy). 


This classification is illustrated in Fig. 3 where C(Vy) is 
shown as a parallelogram. Roughly speaking, with re- 
spect to the direction ry41, V+ consists of all the points 
which are on the top of C(Vw), Vy those on the bot- 
tom and Vy? those on the edges (sides). 


Fig. 3—Classification of the points of Vy. 


Each of the above classes is non-empty and can be 
easily described: 1) Vyt contains all the points of Vy 
whose e sequence has n—1 changes of sign and whose 
last subsequence is of positive sign, 2) Vy~ contains all 
the points of Vy whose € sequence has »—1 changes of 
sign and whose last subsequence is of negative sign, 
3) Vy? contains all the points of Vy whose € sequence 
has n—2 changes of sign or less. 

Let us justify statement 1. It is asserted that if p 
satisfies the conditions stated in 1, then p+6ry41 
EC(Vy) and p—dbryyiCC(Vy). * 

Recall property 2, take each a; in a different € subse- 
quence of constant sign; then from property 2—a) and 
the bound on 6, 


N 
Dita; where | 3 | Gp oe Alay eo ea 


j=1 


9 os 6rv+1 => 
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Therefore p— 6ryi41© Ry’, which is identical with C(Vy) 
by the induction assumption, thus P—oryyiCC(Vy). 
To establish that p+6ry4i1¢C(Vy), note that which- 
ever way the a,’s are selected in property 2—a), the n 
scalars £4; have alternating signs. Since &,>0 and since 
the € sequence of p has only subsequences of constant 
sign, it is easy to see that it is impossible to reduce 
p+dry4 to the form 


N 
Deir: with | ¢:| SCRRLOr Mtl goes 


t=1 


Therefore p+6ry41€ Ry’ and, by the induction assump- 
tion, Pt+ornyi¢EC(Vy). 

Statements 2 and 3 above are justified in a similar 
manner. It is of interest to note that the derivation 
above shows that every point of Vyt, Vy~ or Vy® isa 
boundary point. 

From the above statements it follows immediately 
that the faces of Ry’ are subsets of (7 —1)-dimensional 
vector spaces spanned by (m—1) vectors of the set 
frie te<* = 

Basic Property: All edges of the polyhedron Ry’ are 
parallel to one of the vectors 2ri, 2re, - - - , 2ry. 

From the descriptions (13) of R,’ for 7<n, this is 
intuitively clear. For larger N, it seems less obvious. 
Now, Vy is obtained from Vy_; by translating all points 
of Vy_1t and Vy_1? by +ry and all points of Vy_i~ and 
Vy_i® by —ry. Therefore, all edges of Ry_:’ undergo a 
translation before becoming an edge of Ry’, and to each 
point of Vy_1® is associated an edge of Ry’ which is 
parallel to 2ry. Therefore the above statement follows 
by induction. 

This reasoning leads to an important conclusion: the 
vertices of Ry’ (i.e., the points of Vy) are obtained from 
the vertices of Ry_s’ (i.e., the points of Vwy_1) by: 
1) translating all vertices of Vyi1t and Vy_,? by ry, and 
2) translating all vertices of Vy_1- and Vy_1? by —ry. 


TiN Cs 


E. Ry and Canonical Representation of Points in Rn 


By definition, Ry is the set of all points y in the state 
space from which the origin can be reached in N sam- 
pling periods and 10 less. 

It is obvious that Ry = Ry’ — Ry_1’. 

The question is then: given a point pC Ry’, how is it 
possible to determine whether p is in Ry or in Ry’? 
Let us consider an example in which N=n-+2 and the 
point is p=n. By (12), pC Ry’ and also in Rn4o’. Now 
since the vectors ro, ---°, fn42 are linearly dependent, 
there exist scalars 7; such that 


n+2 
ee teh a 0, with 


i=2 


tke 


| 73 


Hence with 7=1, p has also the representation 
n+2 


‘Ds Da Nii. 


i=1 
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One might erroneously be led to believe from this last 
relation that pC Riz». To resolve this ambiguity it is 
necessary to examine the question of uniqueness of 
representation. To start with, the following definition is 
introduced. 

Definition: Given a point p in Ry’ we have 


N 
p= De E;r; where | &; 


t=1 


Selo (0152. 


To the sequence {£;} is associated a sequence {E:*} of 
+1’s and —1’s by the following rule: 1) £;=£,* for all 
the 2’s for which | £;| =1. 2) For all others, &,* is assigned 
the value +1 or —1; the choice is made so that the 
resulting sequence {E*} has the largest number of sign 
variations. The number of sign variations of the se- 
quence {£,;*} is called the maximal number of sign varia- 
tions of the sequence {é,}; it is abbreviated by U{é£;}. 
Observe that if &;*= —1, then £;<1 and if £;*=1, then 
SoS Salk 
Theorem 2: Let 


N 
p= >) fr, | & Sa; (i= 12, > a4, av); 
i=1 
hence pC Ry’. The point p has a unique representation 
of the above form if and only if U{&;} <n—-1. 
Theorem 3: Let 


N 
re ae are: egimesloces= 15024. e uae 
at 


let N>n. Then p is a boundary point of Ry’ if and only 
if the representation of p is unique. 

Corollary 1: pis a boundary point of Ry’ for N>n if 
and only if U(&;) <n—1. 

Corollary 2: For N>n, any point of Vy, 4.e., any 
vertex of Ry’, has a representation of the following 
form: 


N 
v= 3 bist 
j=l 


where 
|e:| =1,1<i<N, and vf} <n-1. 


The proofs of Theorems 2 and 3 are given in Appendix 
IIL 

The consequences of these facts is that given a repre- 
sentation 


N 
‘Ds 1S Nii 


i=l 


-one can immediately determine whether or not this 


point is a boundary point of Ry’. With these tools it is 
now possible to derive a unique representation of points 
in Ry. Roughly speaking, a point in Ry is represented 
as a vector sum of a boundary point of Ry-1' and 6ry 
where | 5| <1. To be more precise, let us define: 
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1) Syst that part of the boundary of Ry_1’ which is 
made up of the faces whose vertices are in Vy-1* or 
Nae 

2) Sy-1 that part of the boundary of Ry_1’ which is 
made up of the faces whose vertices are in Vy_-y or 
Vy’. 

From the above, if y GC Ry’ but y € Ry_1’ then either 


Sr 
16 Ses ; 
= y+ + 6ry where J (17) 
ae ui eee 
or 
x €Sy-1 
= + — 6ry where 18) 
fs fh : 0 Pa eaat \ 


Clearly such representation is unique, in the sense that 
it is the only representation of a point of Ry of the form 


N= 


y= és t ory where U{ &i, £2, - 


t=1 


-, Eva, 7} ST ie 


Eqs. (17) and (18) give the canonical representation of a 
point in Ry. The canonical representation will be the 
basis of the optimal control that will bring the system 
to equilibrium in the minimum number of sampling pe- 
riods. 


IV. THE CRITICAL SURFACE 


As a final preliminary step to obtaining the optimal 
control, it is necessary to construct a hypersurface in 
state space. This hypersurface is somewhat analogous 
to the switching surface for continuous systems. In order 
to simplify the description of the critical surface the 
case 2=3 will be considered. Outlined in Appendix IV 
is the argument necessary for the general case. 

First define a set of parallelograms: for any integers 
4 and j, such that j7>72>1 the point y belongs to the 
parallelogram @;,;* if 


, 
y= Do bata 
a=1 


where &=0, &=&= --+ =$1=—1, [&|<1, 44 
=fno= +--+ =£,1=1 and 0<£;<1. Pictorially this re- 
quirement is illustrated by Fig. 4(a). Similarly, @;;~ is 
defined in the same way except that the signs of the 
£,.’s are reversed. See Fig. 4(b). 

The critical surface (CS) is the surface consisting of 
the collection of all the parallelograms @;;+ and @;;-. 

The critical surface is shown in Fig. 5 for the case 
n= 3. For synthesizing the computer we shall make use 
of the intersection property of the CS. Let y be an 
arbitrary point. The straight line parallel to r; and going 
through y intersects the CS at one and only one point. 
In other words, 


y= + $n, 


where ¥ is any point of the C'S, determines the scalar ¢ 
uniquely. 


IRE TRANSACTIONS ON AUTOMATIC 


CONTROL 
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Fig. 4—(a) Representation of the parallelogram (;;*. 
(b) Representation of the parallelogram (@,;. 


Fig. 5—Critical surface in the neighborhood of the origin for n=3. 


The uniqueness of ¢ follows from two facts: 1) the 
CS is a connected surface made of the juxtaposition of 
all the parallelograms @;;+ and @,;—; 2) for all integers 
1, J, the parallelograms @;;+ and @;;— are parallel to the 
plane formed by r; and r;; since 7 >7>1, these parallelo- 
grams cannot be parallel to r; by virtue of property 1. 


V. A COMPUTATION FOR AN OPTIMAL CONTROL 


By optimal control is meant the following: given an 
arbitrary point y of Ry, an optimal control for y is a 


sequence fi, fo, - - - , fw with |f;| <1, (¢=1,.2, -- -, N) 
such that 
N 
y= Di firs 
t=1 


In other words an optimal control for y is any forcing 
function satisfying the inequality (2) which brings the 
point y to the origin in the minimum time. 

In the continuous case it is known that the optimal 
control is unique [7]. In the discrete case, it has been 
shown, for the case n=2, that except for boundary 
points of Ry’, the optimal control is not unique [11]. 
The lack of uniqueness of the optimal control may be- 
come intuitively obvious from the following step-by- 
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step characterization of an optimal control: let vy belong 
to Ry; the forcing function fi is the first term of a se- 
quence defining an optimal control if and only if it 
brings, in one sampling period, the state of the system 
to any point of Ry_1. Because of this lack of uniqueness 
it can only be said that such a computation generates 
an optimal control. 

The computation is based on the following theorem. 

Theorem 4: Let ¥ be any point of Ry. Let 


N 
i¢ == ys ili 
21 


be its canonical representation. If y=@r:+7 where 


ECS and if 


a) |d| <1 then f1=¢ is an optimal control; 
b) @>1 then f;=1 is an optimal control; 
c) ¢<—1 then f,= —1 is an optimal control. 


Proof: 
Case a: |p| <1. Let 


Then 


y= ort > bra (19) 


a=2 


is the canonical representation of y because: 1) each 
coefficient has at most absolute value 1; 2) 
v{¢, £2, &,°- °°, Ey} <n—1. f=¢ is optimal because 
it follows from (11) that if fi is applied now, y:1C Ry, 
V1Z., 


N 
eS fra al 


a=2 


¥,= AvY+¢d= 


Case b: ¢>1. It will be established that m=-+1, 
consequently f,= +1 is an optimal control. Consider 
the case n =3 and let @;;+ be the parallelogram to which 
¥ belongs. The cross-hatched area in Fig. 6 serves to 
indicate that | £;| <1 and 0<£;<1. The equality (19) is 
represented by Fig. 6. No generality is lost by reasoning 
on this particular case, because other cases are treated 
in a completely similar manner. Let us use property 2 
and express r: as a linear combination of ro, r; and r;: 


ti = Sore t+ bari + 55055 (20) 
then (>0, ¢;<0, (;>0. Using (20) to decrease ¢ the 
coefficient of r; in (19), coefficients of rz and r; will be 
increased and the coefficient of r; will be decreased: this 
is illustrated in Fig. 6 by the vertical arrows. From (19) 
and (20), 


N 
vy = (6 — Ait Do kata + Mfore + Fri + Gr). 
7 2 
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Fig. 6—Transformation of (19), ¢>1, to the canonical representation. 


As X increases, either ¢—\ becomes equal to 1 or one of 
the coefficients of rz, r; and r; becomes equal to 1 in 
absolute value. In the former case the canonical repre- 
sentation of ¥ is obtained: thus 71=1 and the statement 
is established. In the latter case, let ra be the vector 
whose coefficient became first equal to 1 in absolute 
value; one uses then an expression similar to (20), ex- 
cept that ra is replaced by ray1. As one proceeds in this 
manner one shall eventually reduce ¢@ to +1 and have 


NI 
y=ent Dd Eiri, (21) 


where U{1, &, &,---, Ew’ }<nm—1 and |é,| <1. 
Therefore (21) is a canonical representation and the 
theorem is established. If yC@;;- a similar argument 
would hold. 

Case c is proved in the same manner. 

The above theorem gives a means for generating at 
time t=0 an optimal f;. Bellman’s principle of optimal- 
ity states [5]: “An optimal policy has the property that 
whatever the initial state and initial decision are, the 
remaining decisions must constitute an optimal policy 
with regard to the state resulting from the first deci- 
sion.” 

Therefore: An optimal control will be generated if at 
each sampling instant only the distance, in the direction 
ri, between the present state space point and the CS is 
measured and the forcing function is generated accord- 
ing to the rules stated in Theorem 4. 


VI. REALIZATION OF THE COMPUTER (1 = 3) 


Before proceeding with the discussion of the realiza- 
tion of an analog computer for the third-order system, 
let us introduce the following definition: 

Definition: the critical curve is that curve obtained by 
joining successively the vertices defined by 


N N 
FSS Teer aie eae ale eat siheays fetta: 


i=2 1=2 


From this definition and the definition of the parallel- 
ograms @;;+ and @,;-, the critical surface in two parts, 
that which contains the parallelograms @;;+ and that 
which contains the @;;~. These two parts will be referred 
to as the positive and negative parts of the CS. 

From Theorem 4, the computation for the optimal 
strategy is based on measuring the distance between the 
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state space point y and the CS along the direction ri. 
Let us therefore consider a set of orthogonal axes 
Oyi, ye, v3 with the only stipulation that Oy; be in the 
direction of r; and the unit of length be chosen equal to 
the length of r:. Since any straight line parallel to ri 
intersects the CS at only one point, the CS can be repre- 
sented as yi=W(v2, 3), where P(yo, v3) is a single-valued 
piecewise-linear function. To be specific, W(y2, v3) is the 
juxtaposition of all the parallelograms @;;+ and @j;~ 
expressed in terms of the Oy, yo, y3 coordinate system. 
The plane supporting @,,;+, say 7;;+, has an equation of 
the form 


ae = aij =e bizVo =F CijV3y (22) 
where 41;;* is the first coordinate of the point of 7;;* cor- 
responding to the coordinates ye, y3. The corresponding 
expression for the plane 7,;— which supports @;;— has 
an equation of the form 

Vig = — ig 1 bigha + Cais, (23) 
where 41;;— is the first coordinate of the point of 7;;— cor- 
responding to the coordinates ye, 3. 

The two following properties of the CS are proven in 
Appendix V: 

Separation Property: For all integers 2, 7, with 1 <1 <j, 
if ;;* is a plane containing the parallelogram @;;t, then 
all parallelograms @;:+ for which k#12, 147, and 2<k<l, 
lie on the same side of the plane 7;;T. 

Intercept Property: Tf yiuijt =aijt+bdisyotcizys is the 
equation of the plane 7,,;+ in an orthogonal axes system 
Oyi, Ye, v3 with Oy, in the direction of ri, then the inter- 
cept of 7;:;+ with the 7; axis, 7.¢., a@:;, is negative. 

From the symmetry of the CS it follows that the 
statements of the symmetry property and of the inter- 
cept property are still true when all superscript +-’s are 
replaced by —’s. 

From the separation property of the CS it follows 
that if the point (O, ye, y3) in the Oye, y3; plane lies 


SETA 
con 


Fig. 7—Geometric interpretation of proposed optimal control. 
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within the projection (along Oy;) of @g, then either 


(i) yiei > yj for all i,j such thati # k,j 41 
Or 

a + + 

(ii) Vikt S Viaz 


Equivalently, either 


(i) viet = max { yi3} (24) 
eI 
or 
(ii) yee = min { yas} 
hee 


Reference to Fig. 7 shows that (i) is the true relation- 
ship. By symmetry, 


(25) 


yur = min {yay}. 


Fig. 8—Block diagram of servomechanism with proposed optimal 
control computer. 


+ BIAS 


(b) 


Fig. 9—Physical realization of maximum and minimum network. 
(a) Maximum network. If —bias<min (@¢,-+-, en), then 
A@t=max(e,-++, en). (b) Minimum network. If +-bias>max 
(1 + + + én), then AP~=min (4 + + + en). 
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Therefore, if (0, ye, v3) belongs to the projection of the 
positive part of the CS (or the negative part, respec- 
tively), then, by (24) [or (25), respectively |, a maximiza- 
tion (or minimization, respectively) operation is re- 
quired. Equivalently, in applying either (24) or (25) to 
determine the y; coordinate of the CS, it is first neces- 
sary to determine on which side of I the point (0, ye, ys) 
lies, where [ is the projection of the critical curve on the 
Oye, y3 plane. 

The proposed computer is shown in Fig. 8. Observe 
that c(t), é(t) and C(t) specify the state of the system 
in the physical coordinates. The block 7 transforms 
c(t), é(£), E(t) into yi/(t), yo’ (t), and y3’(t) which are the 
coordinates of the state in the Oy, yo, ys coordinate sys- 
tem. yo'(t) and y3/(¢) are inputs to the block H;;+ which 
contains the adders generating the (22)’s and to the 
block II;;— which contains the adders generating the 
(23)’s. The output of each adder of I;;+ is an input to 
the maximum network [15] whose output satisfies (24). 


Fig. 10—Representation of the vectors for n=3 with 
a single integral. 


—> , 
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Fig. 11—Sets Ri’ and R,’. 
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In a similar manner the output of each adder of II,;~ 
is an input to the minimum network [15] whose output 
satisfies (25). The maximum and minimum networks 
are shown in Fig. 9. 

The signal y2'(t) and ¥;’(t) is also an input to the func- 
tion generator. The function generator generates I’, the 
projection of the critical curve on the y;=0 plane. The 
output of the function generator is positive when yo’ (tf), 
ys’ (t) belongs to a projection of the positive part of the 
CS and negative otherwise. The ON-OFF signal oper- 
ates a switch which selects the appropriate y; from (24) 
or (25), thus giving yi(t) =W[' (2), ys’ () |, where y(t) is 
the ordinate of the point on the CS whose projection on 
the y:=0 plane is [o, yo’ (t), ys'(t) |. The difference ¢(t) 
between 91/(t) and y:(¢) is the distance between the state 
point and the critical surface. ¢(¢) is sampled, passed 
through a zero hold circuit and then through a saturat- 
ing amplifier so that the output is f, for all ¢ in the inter- 
Walt sta ie) 


VII. NUMERICAL EXAMPLE 


To make the meaning of the proposed optimal 
strategy concrete, let us consider an example. In Fig. 10 
are shown the vectors d, ri, ro, r3, 14, and rs correspond- 
ing to a sampling period 7 and roots 0, —a, —1 such 
that e-7=0.5 and e*?=0.75. Figs. 11-13 show regions 


=< 


Fig. 12—Set R; ee 
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Fig. 13—Set Ry’. 
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The monotonic 
increasing length of r;, for increasing & is clear from the 
fact that 


Ry to R4 for these numerical values. 


1 0) 0) 
rn =10 e%* Old. (26) 
O WW Ge 


In Fig. 5 the CS is shown by utilizing the values of the 
r,s of Fig. 10. Contour lines of equal altitude of the CS 
with respect to the y1, y2 plane are also indicated. 

Let us now take the initial state as 


(67) =r Lye Se on ate ap Saeie ifs. 
Since (27) is a canonical representation, then by Theo- 
rem 4, if y(67) =@ri+¥, where CCS, then @>1. Fig. 
7 shows (67) projected onto the CS along a direction 
parallel to ri. ¥ and ¢ are determined by satisfying 


[vs of ] = [vs of (y(WT) — ¢r,)]. 


In this case 6>1 so that the optimal control is +1, 2.e., 
the coefficient of ri. 
At t=T the state of the system is 


(27) 


(28) 


Wo Leary — fo 4 are brs ars: (29) 
Reference to Section IV shows that 
—re + 3r3 + ra + ErseP35*. (30) 


Applying (28) we find ¢=1/2, which is the coefficient of 
r, for (29). Continuing in the same manner for 
t=2T,---, 67 the physical meaning to the proposed 
optimal control as it relates to the canonical representa- 
tion of the state is clear. 

The proposed optimal control generates the sequence 
of forcing functions which is identical to the sequence 
of coefficients of the r;’s of the canonical representation. 


VIII. CoNCLUSION 


This paper has investigated the minimal-time regu- 
lator problem for a saturating sampled-data control sys- 
tem which has a linear plant with real and distinct char- 
acteristic roots. An optimal control has been obtained 
in two stages, first determining the sets Ry’ of state 
space points from which the origin can be reached in N 
sampling periods or less and second obtaining a unique 
canonical representation of all points in Ry, the set of 
state space points from which the origin can be reached 
in N sampling periods and no less. Finally a block dia- 
gram description has been given for an analog computer 
that generates the proposed optimal control. It is inter- 
esting to note that: 1) in the sampled-data case, the 
optimal control is not unique except for the points on 
the boundary of the sets Ry’; 2) as 7, the sampling 
period, tends to zero, the length of ri goes to zero and 
the proposed optimal control becomes, in the limit, iden- 
tical to the usual one for the continuous case: the criti- 
cal surface becomes the switching surface (this has been 
shown in detail in [11], for the case n=2); 3) the 
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parallelograms (23+, ®23;~) of the CS which contain the 
origin lie in the plane spanned by re: and r;. Therefore 
for states close to the origin, our proposed optimal con- 
trol is identical with the minimal time control for linear 
systems of Kalman ([12], statement (4.12)). 

The general techniques used here for discovering and 
demonstrating rigorously the optimality of our proposed 
strategy can be applied to more general cases: such as 
allowing for arbitrary poles for G(s) [17] (both complex 
and multiple) or as Polak has shown introducing 
pulse width modulation together with linear or non- 
linear plants [18]. 


APPENDIX I 
A. Proof of Properties 1 and 2 
Let w,=exp(—Ax7); then from (4), 


br he OS ge LO: (3) 
From (10), the components of r; are 
Eee (ui*di, Mode, Po be sin ae (32) 


Therefore the equations that determine the £&,, are 
(we write & for &, in the following derivation): 


ITE Wee ih ctl ing fe 2 Pe ed 


PoE L Ae pie Abo a eat Sear eee tet 


I 
e 


bn, Epa toot pan = aH (33) 


The determinant A of this system of equations may be 
rewritten as follows: 


A= (u1, p Ei ee oo Mn)™ (34) 


ats Bab® 


where B;=a;—a (4=2, 3,---, m). Of course B.<; 
< +++ <Bn. Observe that the determinant in the right- 
hand side of (34) is closely related to a Vandermonde 
determinant [16]. If we set u:=x in that determinant, 
we obtain a function D(x). If we set x=yo, or ps, or 

* +, OF Mn, the determinant vanishes since it would 
have two identical rows; thus 


D(x) zg (x = bo) (x =~ bs) : | a (x ial bn) F(x), 


where F(x) is a polynomial. Suppose we expand the 
determinant as a function of the elements of the first 
row: the cofactors are independent of x; therefore D(x) 
is a polynomial in x having at most n coefficients distinct 
from zero. But from (31) and (35), D(x) has (m—1) 
positive roots; hence, by Descartes’ rule of signs [16], 
the polynomial D(x) must have alternating signs and 
cannot have more than (m—1) positive roots. Hence 
F(x)40 for x>0. Since A=D(u1) and u>0, AX0. 
Therefore: 1) the £’s are uniquely determined, and 2) 
the ro,8 (k=1, 2,---, m) are linearly independent. 
Thus properties 1 and 2—a) are established. — 


(35) 
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To establish property 2—b), consider the computation 
of &,. The numerator is identical to A except that 6, is 
replaced by N+1—a,. We still have Go Bg som 
<Bn1<N-+1-—a;. Therefore by the above proof the 
numerator is also positive; hence, sgn £,= +1. 

Toestablish property 2—c), we simply observe that the 
numerator of £; is obtained from A by replacing its ith 
column by col(mi%+1, woNt!, + ~~, wat). After (1 —1) 
permutations of consecutive columns the determinant is 


of the same form as the above cases, hence sgn £; 
=e bt, 


B. Proof of Property 3 
We have to prove that if for some arbitrary integer k, 


k+1 


> Ero; = 0, 
1 


(36) 


where 11<v2< -- - <vg41, then the sequence {&;} has 
at least ” sign variations. 

Proof. From property 1, k>n. From property 2, the 
above statement is true for k=7. To establish the result 
for any k>n-+1 let us use induction. Therefore we as- 
sume that for some k>n-+1, any sum of the form (36) 
has a corresponding sequence {é,} with at least » sign 
variations and we have to prove that the same property 
holds for +1. Suppose it would not, 7.e., suppose there 
is a sum 


k+1 


S Os ay — 0, 
1 


(37) 


for which {6;} has »—1 sign variations or less. To be 
specific, let us assume {6;} has »—1 sign variations,‘ 
thus {6,} is a collection of subsequences of consecu- 
tive 6,’s such that: 1) in each subsequence the 6;’s have 
the same sign, and 2) the sign alternates from one sub- 
sequence to the next. Let us use property 2 to express 
r»,,, in terms of 1 of the r,,’s picked in such a way that 
there is one and only one of them in each subsequence. 
Let these chosen vectors be ra; (j=1, 2,:--,). We 
write 


oD Efe; = Topsy (38) 
j=l 


{é;} is of alternating sign by property 2. If we add 6441 
times (38) to (37) we get an equation of the form (36) 
in which {é;} has n—1 sign variations. This process is 
illustrated in Fig. 14. In Fig. 14(a), the signs of the 6,’s 
are shown. In Fig. 14(b), the signs of 6.41; are shown. 
Since each product 6,416; is of the same sign as the cor- 
responding 64, it is clear that the addition will not 
change the number of sign variations. This contradicts 
the induction assumption; therefore the induction is 


established. 


4 If there are less than (w—1) sign variations the same reasoning 
applies with a few obvious modifications. 
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Ist 2nd 3rd 
SUBSEQUENCE SUBSEQUENCE SUBSEQUENCE --- ETC. 
Fi 
Iglslg Iz 


I; <2 Iz 


(a) 
ieee. i 
(b) 


Fig. 14—(a) Signs of the 6;’s. (b) Signs of the d41£7’s. 


APPENDIX II 


The purpose of this Appendix is to detail the induc- 
tion proof of the fundamental theorem which asserts 
that Ry’=C(Vw). Before studying this proof, the 
reader should be familiar with Section ITI-D. 

1) Consider the set Vy41 of all points obtained by 
adding ry41 and subtracting ry41 to each of the points 
of Vy. Clearly Vy41 includes Vy4u. However, there are 
points in Vyy; that do not belong to Vwi41; these are 
obtained by subtracting ry41 from a point of Vyt or by 
adding ry41 to a point of Vy~. In both cases, the result 
is a point whose € sequence includes » sign variations. 
These are the only points in Vy41 that are not included 
in Vyui. 

2) Any point u of Ry41’ can be written as 


N+1 


a= », E.r; 
gail 


with | &;| <1. This sum can be interpreted as a point of 
Ry’, namely 


N 
> a a 
1 


to which is added én4irwyi1. Since Ry’ =C(Vw) by the 
induction assumption, Ry41’ = C(Vy4i) since Vy41 is ob- 
tained by adding +ry41 to all the points of Vy. There- 
fore the induction will be established if we prove that 
C(Vy41) =C(Vwii). To establish this fact we need to 
prove that any point p of Vy* is such that p—rwy4,1 is 
an interior point of C(Vy4) and that any point q of 
Vy is such that q+ry41 is an interior point of C( Vy). 

3) If pisa point of Vy*, it has been shown that it isa 
boundary point of C(Vy) and by definition, p—6ry41 is 
interior to C(Vy) and p+é6ry41 is exterior to C(Vy). 
(See Fig. 15.) Note that p+ry41 is a point of Vw4i. 
Consider the semi-axis p—Arw41, (A>0); since C(Vy) is 
bounded and convex, it will intersect the boundary of 
C(Vy) at only one point x= p—D’ryi1. Clearly ’ >6>0. 
This boundary point x lies on a face of C( Vy); hence can 
be written as follows: 


n 
x = ys AGS; 
7=1 
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BOUNDARY OF (C Vj) 


Sone! 
V=P-(A+N yyy 
Sy) Enel 


Fig. 15—Geometric basis for proof of fundamental theorem. 


where the s; are vertices of C(Vy), \;>0, and 


DM = 
7=1 
We shall prove, below, that none of s; may belong to 
Vyt. Therefore all points s;—ry41© Vw4i. In particular, 
the point y defined by 
N 

y =x— tye = DAS: — tw) = Pp — (+ Dew 
is a boundary point of C(Vwy) and is on the axis 
p—Arwy41. Since p+ryy1 and p—('+1)rwy41 are points 
of C(Vw41) and since \’ >0, p—rwy41 is an interior point 
of C(Vy41). The same proof, with slight modifications, 
applies to q+rw41. Thus, C( Vis) = C( Vai) which was 
shown to be equal to Ry41. 

4) To complete the proof we have to show that none 
of the points si, s2, ---, S» of Vy may belong to Vyt. 
Suppose a certain number of them (including, possibly, 
all of them) are in Vy*: more precisely, let s;,, s;,, - - - 
s;, belong to Vyt. Therefore s;;—6rvii1GC(Vy) tae 
j=1, 2,::-, k. This-implies a contradiction. Let 
u-z=c be the equation of the hyperplane containing 
Si, Sx, °° * , Sn; 1.€., u-s;=c. This hyperplane is a face of 
the convex polyhedron C(Vy); therefore it is a support- 
ing hyperplane of C(Vw): that is, the sign of u can be 
chosen so that u-y>c for all yCC(Vy). Now p=x 
+)/rv41€ C(Vy) and is not in the hyperplane u-z=c, 
hence, since \’>0, u-ry4i>0. On the other hand, it is 
alleged that s;,—dSrv41©@C(Vw), hence, since 6>0, 
—u-‘ry4i>0, which contradicts the previous inequality. 
Therefore none of the points si, s2, - - - , 8, may belong 
to Vy+. This concludes the proof that C(Vy) = Ry’. 


APPENDIX III 
Proof of Theorem 2 


We prove first that if the representation is unique, 


May 


then U 1Es} <n-—1. Let us prove this statement by con- 
tradiction: 2.e., we assume v{é,} >n. Therefore in the 
associated sequence {£;*} there are at least 1 sign varia- 
tions. Thus it is possible to find indexes au, a2, - + + , Qn 
with ai<a;< --~ <a, “such thateethe ‘sequence 
baa™, Ean", Sale, on as Of alternating signeion dem 
niteness let £y* = —1 which implies vy <1. (If &y*=.+1 
the following reasoning needs a few trivial modifica- 
tions.) Now from property 2, if 


Lo Masta; + ty. = 0, 
a—1 
the n.,’s alternate in sign and sgn(ma,) = —1. 


Therefore, using the observation relating the &;* and 
£;, there exists an e>0 sufficiently small such that in the 
relation 


N N N 
= D és + € De Nagee — y= De Cita 
a 1 ai 


(where ¢; is the resulting factor of r;), we have 


et a= -,n). 


Consequently if v{E} >n, the representation is not 
unique. Therefore we have established that if the repre- 
sentation is unique, U{£;} <n—1. 

We prove next that U{£;}<n—1 implies that the 
representation is unique. Again we use contradiction: 
suppose the representation is not unique, 7.e., 

N N 
pHD)o Sti =D) ae | &; = 
t=1 t=1 


<1, |x 


for? = 1,2, - += 


then, 


N 

ye (ni — &)ri = 0, 

1=1 
where at least »+1 of the (n;—&,) are different from 
zero. Furthermore, by property 3, {iE} has at least 
nm sign variations. 

To be specific, let the first nonzero 7; 
Since for all O<A<1, 
there are (at least) n+1-£,’s, say the £4,;'8, with the 
property, thats-f< 15 shi > oie t5e<. and 
a1 <a2< +--+ <Qny1. Therefore U{£;} >n because the 
inequalities just obtained show that we can choose 
fa, Ss er lee tS 1, *, and these £;* 
would already by themselves constitute m sign varia- 
tions. Therefore U(é;)>n. In other words, if the repre- 
sentation is not unique then U(é;)>n. Therefore, if 
U(E;) <n—1 the representation must be unique. This 
concludes the proof. 


—&; be positive. 


Proof of Theorem 3 


We prove the uniqueness of representation implies 
that p is on the boundary. First, we exhibit a point 
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p’ERy’ which is arbitrarily close to p. For any e>0, 
arbitrarily small, pick p’= > J£,/r; where for i=1, 2, 


|, 
f; — if &; > e 
£,’ = 4&,/2 it —¢«r— &. S e 
gE; +e bse es 


Next we exhibit a point p’’€ Ry’ which is arbitrarily 
close to p. Take p’’=p+e(sgn éy)rnyy1 with e>0. 
Clearly for € arbitrarily small p” is arbitrarily close to p. 
Next, the maximum number of sign variations of the 
sequence { £1, f,--:, En, e(sgn Ey)} is vf}. From the 
assumed uniqueness and Theorem 2, VU {é;} <n—-1. 
Hence the new sequence has also a maximum number 
of sign variations <n—1. This fact together with prop- 
erties 2 and 3 does not allow p”’ to be reduced to the 
form 


* 
DS Nits 
1 


with ni <1, by writing ry+1 as a linear combination of 
n or more.of the preceding r;: it is easy to see that any 
such attempt would result in some of the £; becoming 
larger than one in absolute value. Hence p’’¢ Ry’ and 
p isa boundary point of Ry’. 

We prove next that if p is on the boundary, then the 
representation is unique. 

Since p is a boundary point and since each face of 
Ry’ is a subset of any of the (n—1) dimensional sub- 


spaces spanned by (m —1)-vectors of the set 
(ri, f2, - - - , rw) and since ry41 is outside any such sub- 
space (property 1), at least one of the points 


pie(sgn Ey)ryy1 (for €>0 arbitrarily small) must be 
outside Ry’. The maximum number of sign variations of 
£1, £,---, Ey, e(sgn tw)} is equal to v{é,}. Now, by 
the previous reasoning, it follows that if v{E,} Bape 
for ¢ sufficiently small, p+ e(sgn €y)rnwy:1 and 
p—e(sgn —y)ryy1 can be written in the form Nil iy 
with | ni <1, i=1, 2,---, NM. This would mean that 
both points are in Ry’. Since this is not the case, U {é:} 
<n—1 and the representation of p is unique. This con- 
cludes the proof. 


APPENDIX IV 
THE CRITICAL HYPERSURFACE 


The purpose of this appendix is to generalize the con- 
cept of critical surface in m-dimensional state space. 

1) Consider all (n—1) dimensional parallelepipeds 
defined as follows: 

Let the integers 41, 72, - - * , tn1 Satisfy the condition 
Ec at < bya Lhe parallelepiped OF iji,---é,-, 
(O~ zig + «in» Fespectively) is the set of all points 

in—1 


a ar 


j=l 


39) 


—S 
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where 
£=0, 
fi, €i., °+ + , &,, may take any value in the interval 
eae 


&,1€[0, +1] (E:.1€ [—1, 0], respectively), 
all other £; take values +1 so that U(E,) <n—2. 


2) The CS is the collection of all such parallelepipeds. 
3) Intersection theorem. Given any point y¥ of the state 
space, there exists one and only one scalar ¢ such that 
Neo Og + $r1 (40) 

where YECS. 
a) Let us first establish existence. Let the point + be- 
long to Ry and let it have the canonical representation 


Y= Yet Ole (41) 
where 
N-1 
’ aa S, Nit 
1 
is a boundary point of Ry_i’. Observe that 


0 fm, Noy * 8, NN=A; 5} <n—1 from the definition of a 
canonical representation. If © { m2, Nagkove eta, 5} 
<n—2, y—m1M is a point of the critical surface, and a 
suitable value of @ is m1. 

If O{ no, i =. a, 5} =n—1, there exist n—1 ele- 
ments of the above sequence, say 7.,, such that no, <1, 
Nase 1; Nes < 1h): as Let us" express. rye asa linear 
combination of ri, °raj; fas) Tay > Ta, By propertyals 
the coefficient 6 of ry in (41) can be reduced in absolute 
value. This process will stop either because 6 is reduced 
to zero, or because one of the components of ra,, 
hese becomes equal to unity in absolute value. In 
the first case we repeat the procedure using ry_1. In the 
second case, either the resulting sequence 7,’ has its 
maximum number of sign variations reduced by at least 
1 or it is still 7—1. In the former alternative, we have 


N= 


y=m'tit dari t ory, 


i=1 


where O{ ne’, Nay 7) as 9 WML 5’} <n—2. Hence d=’. 
In the latter case a new set of elements ng,’, 78,', °°: , 
np,-;, can be used to repeat the process outlined above. 
By successive application of this reduction technique, 
y can be reduced to the form (40). 
b) We establish the uniqueness of ¢. Write (40) more 
explicitly: 


M 
G Pian a| ce 1S, Li; (42) 


22 
where | &;| <1 (@=2,3,---, M) and U {é;} <n—2. Thus 
there are at most n—1 &,’s, say &a,, €a,, ° * > » such that 
fee Ua eae ere ly earl gs Orathersame condition in 
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the opposite signs). But from property 2, when r; is ex- 
pressed as a linear combination of ra,,- °°, fa,-, and 
r; (where k is arbitrary but larger than M) the coeff- 
cients of the combination have n—1 sign variations. 
Therefore any attempt in (42) to vary ¢ will introduce 
a new sequence &;’ with at least m—1 sign variations. 


APPENDIX V 
PROOF OF SEPARATION AND INTERCEPT PROPERTIES 


The purpose of this Appendix is to prove the separa- 
tion and intercept properties of Section VI. 


Separation Property 
Let 


Ky=—re—fs— °K ritreat + + + trj(1<i<y). 


The point x,; is a vertex of @,;+. The plane II,;+ is the 
plane passing through the points x;;, Xi41,;, Let 
x;; designate the four-dimensional row vector whose 
first three components are identical with those of x;; 
and whose last component is unity. Let x’ be the cor- 
responding four-vector to an arbitrary three-vector x. 
The plane U;;+ has an equation given by 


Xi,j+1- 


det(x’, Xi, Xi413) Xij41) = OF 

where the four vectors in the parentheses are the rows of 
the determinant. Let y = (m1, 72, 73) be an arbitrary point 
of Oxt where k and / are fixed. Let y’=(m, mo, 73, 1). 
The separation property will be established if we show 


that 


Met kp xtc > 0 . forall k, 7, 
because it would imply that for all 7, 7 with 1<7i<j, 
all points y of all O.7+, where kz or 14j, be on the 
same side of II;;*. 

Let us establish the property in the case k>17, /> 7. Let 
k=ita,l=j7+, hencea>0and 6>0. We have to show 


that 


det(Xita,j+8; Xijy Xi+1,7) Xipw SO orale S 0, iS 0, 


because we need only establish the property for the 
vertices of the parallelograms 0,,*. 

Let A be the above determinant. Subtract x;; from 
each row of A, thus the last column has only one non- 
zero element. Expanding with respect to that row, we 
get 


Dee Ct ee een Xeitthep ig — Xa; Rage, — Xs) 


where the vectors are unprimed since they are now three- 
vectors. Let us detail the calculation for the case 
ita<j. 


a 8 
LS dei(—2 Doering + Dy tia) —2revy, ria), 
q=1 


q=1 


and by the linear property of the determinant, 
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A= 4) det(rig, —reqi, rit 


q=1 


B 
= 2 »y deve, 


q=1 


— fa, Lia) 


A = 4 D5 det(rizs, riya, F741) 


q—1 
B 
+ 2D) det(rigt, rita, Ti+0)- 
q=1 
Since i+a<j, then 1+q<j+1 and each of the deter- 
minants in the above sum is of the form 
1 1 1 
det(ra, fg, fy) = dided spat po gt") | i o* Be ares 
[Lae can CO gaa 8 a 
with a<6 <y and the notations of (8) with w;=exp A:T. 
Since 0<pi<po<ps;, the determinant is a_ positive 


Vandermonde determinant. Hence A>0. 
The other cases are proven in a similar fashion. 


Intercept Property 


The parallelogram @;;* is defined as 


a g—1 
— ere + Dore + mrigs + ery; 


k=1 t+1 


—1<m<1,0<m< 1}. 


{xix = 
(43) 
The plane II;;+ is then 

{xix = 
To find a;;, the intercept of II;;+ with the Oy; axis, set 


X =r, in the equation of I;;+, thus, with obvious nota- 
tions, 


= s Tae ee + Auriga t Agr;s; Ai, Ag arbitrary. } 


k—2 742 


ery = a+ b+ Auriga H+ Dor; (44) 
or 
bri — Aifiz1 — Aor; = at b. 
Solving for w, we get 
Ss det(a + b, ri41, r;) 


det(ri, Pee, ) 


_ det(a, riy1, £3) 


det(b, Ti+]; f3) 
det(ri, rsy1, rj) det(ri, riya, ry) 


Since 


i i=1 
a=—).r, and b= te 


k=1 142 


it follows that each determinant is negative and <0. 
Therefore a;; <0. 

The equation of II,;~ is identical to (43) except for a 
change of sign of both summations. Hence in (44), a 
and b change sign, as does yw. Therefore in the equation 
of I,;-, a;; appears with a minus sign. 
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Theory and Design of High-Order 
Bang-Bang Control Systems" 
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Summary—In this paper the nonlinear equations which describe 
the switching hypersurface of an Nth-order linear time-invariant sys- 
tem, with real negative distinct poles, are developed when the input 
to the system is restricted in amplitude, either intentionally through 
the use of a relay or due to saturation of the power element. 

Based on the equations of the switching hypersurfaces, a design 
procedure is offered which will result in the optimum transient sys- 
tem response for any initial output or error initial conditions in the 
absence of an input. 


INTRODUCTION 
ale HERE are many papers,’ both in American and 


Russian literature concerned with the general the- 

ory, existence, and properties of the solution, as 
well as a multitude of approximate designs, for the so- 
called “bang-bang” control problem. 


* Received by the PGAC, December 10, 1960; revised manu- 
ipt ived, March 1, 1961. ; : y 
cae Dept. of Elec. Engrg., University of California, Berkeley, Calif } 

1L. I. Rozonoer, “L. S. Pontriagin’s maximum principle in the 
theory of optimal systems,” Automation and Remote Control, vol. 20: 
October, November, December, 1959. (English translation.) : 
2C, A. Desoer, “The bang-bang servo problem treated by vari- 
ational techniques,” Inform. and Control, vol. 2, pp. 333-348; Month, 
sae B. Lee, “Design of Optimum Multivariate Control Systems,” 


ASME Paper No. 60-JAC-5; 1960. 


From a theoretical viewpoint, the “maximum” prin- 
ciple of Pontriagin' provides the general properties of 
the optimal control function, provided that an optimal 
control function exists. Furthermore, if the controlled 
system is linear, then the maximum principle is a neces- 
sary property of the optimal control function. Also, 
related papers,”** such as the adjoint system method 
of Desoer,? show that the output of the adjoint system 
may be used to determine the optimal control function; 
however, Desoer’s paper does not describe in detail the 
nonlinear transformation which transforms the initial 
output of the actual system to the initial values of the 
adjoint system. 

On the other hand, many approximate solutions for 
the second- and third-order cases exist in the litera- 


4E. B. Lee, “Mathematical aspects of the synthesis of linear 
minimum response time controllers,” IRE TRANS. oN AUTOMATIC 
ContrROL, vol. AC-5, pp. 283-289; September, 1960. 

5 Yu-Chi-Ho, “Solution Space Approach to Optimal Control 
Problems,” ASME Paper No. 60-JAC-11; 1960. ; 

6 J. P. LaSalle, “Time optimal control systems,” Proc. Natl. Acad. 
Sciences, vol. 45, pp. 573-577; April, 1959. 

7]. P. LaSalle, “The Bang-Bang Principle,” RIAS, Baltimore, 
Md., Rept. No. 59-5; November, 1959. 

8 R. Bellman, I. Glicksberg, and O. Gross, “On the bang-bang 
control problem,” Quart. Appl. Math., vol. 14, pp. 11-18; 1956. 
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ture.°-!§ However, the approximations used do not stem 
from the knowledge of the exact solution of the problem, 
but they are mostly based on vague assumptions. 

The purpose of this paper is to present in detail the 
various linear and nonlinear transformations on the 
error variables, such that the system transient response 
is optimal in the minimum error time sense. This paper 
deals only with an autonomous system, that is, a system 
with zero input, but variable initial conditions. The 
optimal transient response is to be interpreted as the 
system behavior due to arbitrary error or output initial 
conditions. These nonlinear transformations are carried 
out bya nonlinear computer, which may be, in practice, 
either of digital or of analog nature. 


STATEMENT OF THE PROBLEM 


Given a plant with the transfer function 
GEA (Stes) = (5 SN), (1) 


and the feedback connections shown in Fig. 1; the input 
to the plant is provided by a relay or maximum-effort- 
type element, and the input to the relay is the manipu- 
lated variable m(t), which is the output of the nonlinear 
computer. The plant output is subtracted from the input 
to provide the error e(t). 


LINEAR 
SYSTEM 


NONLINEAR 
COMPUTER 


RELAY 


+! 


nities c(t) 


Fig. 1—Block diagram of the system. 
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10 A. M. Hopkin, “A phase plane approach to the design of satu- 
rating servomechanisms,” Trans. AITEE, vol. 70 (Application and 
Industry), pp. 631-639; 1950. 

uP, C. McDonald, “Nonlinear techniques for improving servo 
performance,” Proc. Natl. Electronics Conf., vol. 6, pp. 400-421; 
1950. 

2 J. L. Preston, “Nonlinear Control of a Saturating Third Order 
Servomechanism,” Mass. Inst. Tech., Cambridge, M.I.T. Tech. 
Memo. 6987-TM-14; 1954. 

13 P, Wang, “The Design of Relay Type Control Systems for 
Random Inputs,” Ph.D. dissertation, Univ. of California, Berkeley; 
June, 1959. ; aie ; 

“S. S. L. Chang, “Optimum switching criteria for higher order 
contractor servo with interrupting circuits,” Trans. AIEE, vol. 74, 
(Application and Industry), pp. 273-276; November, 1955. 

1 N. C. Walker, “A Predictor Servomechanism,” M. S. thesis, 
Univ. of California, Berkeley; 1953. 

16 L. M. Silva, “Nonlinear Optimization of a Relay Servo,” M.S. 
thesis, Univ. of California, Berkeley; 1953. 

17 R. E. Kuba and L. F. Kazda, “A phase space method for the 
synthesis of nonlinear servomechanisms,” Trans. AIEE, vol. 75, 
(Application and Industry), pp. 282-290; November, 1956. 

18 A. M. Hopkin and M. Iwama, “A Study of a Digitally Pro- 
grammed Optimum Relay Servomechanism for Nonlinear Control 
of an Airframe,” Electronics Res. Lab., Univ. of California, Berkeley, 
Rept. No. 60; February, 1957. 
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It is assumed that the poles of the system are si, + --, 
sy such that 


OE Gh ES Sh RS (2) 


Fig. 2 shows the s-plane plot of the transfer function 
G(s). The s; values are positive. 

The requirement on the system response is that c(t) 
=r(t) =0, after a finite transient time which is the mint- 
mum possible time. 

It is desired to determine the nonlinear computer 
which, after operating on the error, will generate the 
manipulated variable m(t) resulting in the satisfaction 
of the minimum time requirement. 


Fig. 2—s-plane pole configuration of the linear plant G(s). 


PRELIMINARY THEORY 


Since the output of the system is to be identical to the 
input after a finite transient minimum time, then the 
error and all of its derivatives must be reduced to zero 
simultaneously in the minimum possible time. Previous 
investigators have proved the following theorem: 

Theorem 1: Given the Nth-order linear time-invariant 
system, with poles real and nonpositive, connected as in 
Fig. 1, the error and all of its derivatives may be re- 
duced to zero simultaneously, in the minimum possible 
time, with at most WN trajectories, if the system is con- 
trollable, requiring at most N—1 switchings (reversals) 
of the relay, and an initial-on and final-off operation 
provided that r(t) =0. 

The above theorem is a direct consequence of two 
theorems proved by Bellman.® The first of these theo- 
rems states that the optimal control function exists and 
is of the bang-bang type, 7.e., | F()| = 1, and the second 
theorem shows that the control function needs to change 
sign at most V—1 times. 

Let the input to the system be zero. The output of the 
plant may have any initial value and the error of the 
system may have any initial value. The problem is to 
reduce the error and its derivatives to zero in the mini- 
mum possible time. 

Let the output of the relay be 


PG) =A (3) 
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where A= +1 or —1 depending on the sign of the func- 
tion 


m(t). (4) 


Between switchings of the relay, the control function is 
a constant, hence, 


C(s) = G(s)(—A/s); (S) 


therefore, the output of the system satisfies a linear 
differential equation of the form 


dN c(t) 
dt 


ach) 
an—1 = 
atN— 


4 = == + acd) = — A, (6) 


Since the input is zero, then, 
Ge) — elt); c(t) — — e{i);'- +. - 
By using (7), (6) becomes 


dN e(i) 
dt 


s¢N)(4) = — e(f). (7) 


a se(7) de(t) 
an—1 os Ss" ee Qa, 


a dt 


+ ave(t) = A. (8) 


The Nth-order linear differential equation above may be 
reduced to a system of JN first-order differential equa- 
tions by the following change of variables 


Vi =e) v= ee V3 = ee - 93 49n = e(N—-1), (9) 
Using the above substitution, the Nth-order differential 
equation is reduced to a system of JN first-order linear 


differential equations, 


V1 Sl Be: 

yo = V3 

Yn—-1 = IN 

YN Pe Ot a IVa, —— 9" 8 = ON VN =f (aN (10) 


which is of the matrix form 


y=Ayt+f, (11) 
where 
Vig (v1, Tae yn); f= (0, 0, cae 0, A) (12) 
are column vectors and the matrix A is 
0 1 0 OP 0s, ye 8) 
0 0 1 ote 10) 
0 0 0 1 
‘A= E13) 
0 0 0 (Rr -ge as) L 
Sy eS LE el 


Of course, the eigenvalues of the matrix A are the poles 
of the system. 

The matrix differential equation (11) may be reduced 
to the diagonal form by the following procedure: Let 
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S be the matrix which has as its diagonal the poles of the 
system, 2.e., the eigenvalues of A. 


= Sil 0) 0 (hens @ 
0) Ge 0) cos @ 
S — 


ats oe 
| 0) 0 0 0) 2 oo = Ray 
then, there exists a nonsingular matrix P, 
1 1 1 
= — S$ — sv 
Pe Sa So? > SN ; (15) 
(=)! (—sy)" 
such that 
S = P-!AP, (16) 
and if 
X= Pay, (17) 
boa (18) 
then (11) reduces to 
x=Sx-+ 8. (19) 


The transformation of variables (17) is linear, hence, 
when y=0, then x=0. 
Let (0;;) be the elements of the matrix P™!, 


bu ead : bin 


oS (20) 


byi +: byw 

Note that the columns of the matrix P are eigenvectors 

of the matrix A and that the rows of the matrix P7! 

are the reciprocal basis eigenvectors of the matrix A. 
From (19), one obtains the following differential equa- 

tions: 


ty = — 514%, + byiA 
to = — $o%_ + byeA 
xn = — SVNXN ++ bynA. (21) 


Hence, the variable x; is the solution of the first-order 
differential equation 


a SS SG Ay ata bjvA (22) 
which is solved to yield 
a(t) = (ajo — bjwA/s;)e—8i# + byvA/s;; ¢ > 0 (23) 


where «jo is the initial value, at t=0, of the variable 
x;, and ¢ is positive greater than zero. 


/ 


< vi Ly \ as 


< 


=24 


Fig. 3—Plot of positive time trajectories projected in the v—vx 
phase plane for A=+1 and sx/s;=2.5. 


One may apply an additional linear transformation 
of variables in order to clarify the equations. Let 


Sj 


v(t) = Ab) eS (24) 
bin 
using transformation (24), then (23) reduces to 
Be — Ale + A; 7 = 1,2, -- +N; t>.0. (25) 


One may solve for the time #; in terms of the v; variables. 


U50) ae A 1/33 
t=In (=~ (26) 
v,;(£) —A 
in particular, for 7=1 
¢ = In [(a1 — A)/(v(t) — A)]/;  t>0 (27) 
substituting (27) into (25) to eliminate time 
u(t) = (veo — A)[(o1(4) — A)/(r0 — A) + A 
IR Doe aio pies Orie (28) 


Eq. (28) describes the equations of the trajectories in 
the phase space, 7.¢., given an initial point and a con- 
stant relay output of —A, the relation between the tra- 
jectory coordinates is uniquely described. Note that 
(28) describes a curve in N-dimensional phase space. 
Figs. 3 and 4 show the trajectories of s;/s1=2.5. The 
mathematical relation between the v variables and the 
error variables is given by (9), (17), and (24). Thus, ina 
physical system one may obtain the v variable as fol- 
lows: 
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Fig. 4—Plot of positive time trajectories projected in the v,=vx 
phase plane for A= —1 and sx/s:=2.5. 


c(t) 
(S+S,)(S+S,) +e0(S +Sy) 


IDEAL ALL-ZERO NETWORK 


Fig. 5—Network realization of the v variables from the error signal. 


1) Differentiate the error N—1 times to obtain the y 
variables. 

2) Apply the linear transformation (17) to obtain the 
x variables after the matrix P is inverted and the 
(b;;) elements obtained. 

3) Apply the linear change of variable (24) to con- 
struct the v variables from the x variables. How- 
ever, in a physical system one may obtain the v 
variables directly from the error by operating on 
the error with an all-zero ideal network with trans- 
fer function 1/G(s), and by operating on the single 
resulting signal by a collection of lag networks 
each of the form s;/(s+s,) to construct each vari- 
able v;. This procedure is shown in Fig. 5 and the 
proof is indicated in Appendix I. 


~~ ee  e 
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OPTIMAL TRAJECTORIES AND THE CONCEPT OF 
SWITCHING SURFACES 

There exists a single trajectory, for a given A, which 
is unique and passes through the origin of the phase 
space. Let the set of points (V) = (u, - , Uv), belong- 
ing to that trajectory, be described by the subscript 
N-1, (Vy-1). This trajectory, referred to as the final 
trajectory, has the property, that if (V) belongs to 
(V1) then the state point (V) may be brought to the 
origin without reversing the polarity of the relay output 
and in the minimum possible time. 

In addition, there exists a set of points in the phase 
space (Vy_») such that if the state point (V) belongs to 
the set (Vy_2) then the terminal point of the trajectory 
is set (Vy_1), hence, the state point (V) belonging to the 
set (Vy_2) may be brought to the origin with only one 
switching or reversal of the relay and in the minimum 
possible time. 

Since the solutions of differential equations are 
unique, the polarity of the relay output during the 
trajectory originating on (Vy_2) and terminating on 
(Vy-1) must be opposite to the polarity of the relay 
output during the trajectory originating on the set 
(Vy_1) and terminating on the origin of the phase space. 
Furthermore, the path followed from (Vwy-_2) to (Vy-1) 
and from (Vy_1) to (0) is optimal, and, although physi- 
cally obvious, it is a direct consequence of Bellman’s 
“principle of optimality.” 

Proceeding similarly, one establishes that there exists 
a set of points (Vy_3), such that if (V) belongs to 
(Vy_3) then the state point may be brought to the 
origin of the phase space with only two switchings or 
reversals of the relay and in minimum time. Note that 
trajectories originating on (Vy_3;) must terminate on 
(Vy-2). 

Following the same line of thought, one may estab- 
lish the following: There exists in the phase space a set 
of points (Vi) such that if the state point (V) belongs 
to the set (Vi), the state point may be brought to the 
origin, in the minimum possible time, with exactly N —2 
switchings or reversals of the relay. The set (Vi) is 
called the switching hypersurface of the system. Clearly, 
trajectories originating on (V;) terminate in (V2). More- 
over, trajectories originating on (V2) terminate on (V3), 
and so on. Hence, the set of points (Vi) contains the sub- 
set (V2) which contains (V3) which contains... (Va) 
which contains the origin (0). An arbitrary set of initial 
conditions, which do not necessarily lie on the switching 
hypersurface, is the set (Vo). 


TECHNIQUE FOR CONTROL 
Given a state point (V), which describes the present 
state of the system, one must test to see if (V) belongs 
to (Vj), i.e., if the state point is on the switching hyper- 
surface. If (V) does not belong to (V1), then the relay 
must generate the appropriate polarity such that the 
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resultant trajectory will in finite time terminate on the 
set (Vi). If (V) belongs to (Vi), then the relay must 
produce the correct polarity such that the resultant 
trajectory will terminate on (V2), and so on. This pro- 
cedure satisfies the requirement that, given any initial 
condition, the state point may be brought to the origin 
with at most N-+1 relay operations, consisting of a 
turn on, N—1 switchings or reversals, and a turn off 
of the relay. If the state point reaches the origin, then 
the error and all of its derivatives are reduced to zero 
simultaneously and the restrictions on the transient 
response are satisfied. 


THE EQUATION OF THE SWITCHING HYPERSURFACE 


Let A* be the relay output during the final trajectory. 
Since the origin is the terminal point of the final trajec- 
tory, from (28), the final trajectory satisfies the equa- 
tion 


Ne sk/ 81 
0= Ve Nov — At )es Ne 
[=e —- ) ( ee 


pee 


SNe (29) 


Eq. (29) describes the set (Vy-1). It is true only for 
t>0. 

The set (Vy_2) was defined as the set of all trajectories 
terminating on the final trajectory (Vy_1). During this 
trajectory the output of the relay is —A*. Therefore, 


Or you Ae 
%N-1 = ( (Op yee 
Cine A 


-NGe) 


i> 0 


The set (Vy_3) was defined as the set of all trajectories 
terminating on the set of trajectories (Vy_2). The relay 
output during these trajectories must be —(—A*) =A*. 
Therefore, 


tien A ee 
U,N-2 = (=) (nee =n) LAS 
Cry ssy 


OE Rasetn NAO MEY 


Proceeding as above, back to the second trajectory, one 
determines the relationship between the (V1) and (V2) 
sets for t>0, 


V1.9 — AX*\ 8k/ 81 
=| Soe es Ay * 
Me ea i ae =) (Ve,1 A ) + A 
B= 223, , NV, for N odd. (32-a) 
Daya AGN oe - : 
Co (ae (V1 rey ee eat 
(GES IE , N, if N is even. (32-b) 


Eq. (32) describes the switching hypersurface of the 
system in a parametric form. Note that (29), (30), and 
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(31) are restrictions imposed on the (V2), (Vs), °-°, 
(Vy_-1) variables. Solving for v,%,v-1 from (29) and sub- 
stituting into (30), then solving for v;,7y_2 from (30) and 
substituting into (33), etc., the following set of equations 


is obtained: 
= Tuyea— A\ 
= [Ke 


Ve wed AO 
a Waar erates ae 
Oya tp 


v Lee AEN GE 
| 2at — at) | (33-b) 


+ 
. Duane ieee eee 
CRESS 2 A a peremn s aape, 


OL INO) = Ne 


*\ sk/ sy 
728" i (os A ) 4 
V1,N—-1 + A* 


0 pS A* sk/s1 
fs eSty"f ws 


and for NV odd 


11, + A*\ 8k/ 81 1,2 — A*\ sk/ 81 

1+ At = (=) {a* ais (==) 
1,2 + A* OMe ae ar As 

ee = =) 
V1,n-2 — A* 

: {—2a* a (- “F =) 
V1,N-1 ac ae 

{2a* se Ax ee a =y"tt 

== hes 


. \ \ (33-n) 
for k=2, 3, ---, N and for positive time. 

Eq. (33-n) indicates that the variables of the switch- 
ing hypersurface (V1) = (v1, - - - , uv) are related by a 
total of N—1 nonlinear algebraic equations which also 
involve the (unknown) values of the variable z; at the 
instant of the second switching, at the instant of the 
third switching, ... , at the instant of the N—1 switch- 
ing of the relay, and also the (unknown) value of A* = +1. 

The equations are of the form 


(33-a) 


x 
Vt,N-1 — A* = 


pe 


Doe FOS ;50k?s Suan Uy,25 °°)? 3 Ur =1) (34-a) 
Veriee ai s( S705; 0025 P1525 - > * (3, 01,Wt) (34-b) 
VN-1,1 = fu—-1(s33 A* 5 01,13 21,23 * * * 5 21,N-1) (34-m) 
Wa = fn (S73 A*5 01,13 01,23 > * + V1.1) 

LOT] este EN, (35) 


Thus we have a total of N—1-equations involving the 
relationship between N variables of the switching hyper- 
surface, and, in addition, there are N—2 unknowns. In 
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order to obtain the equation of the switching hyper- 
surface, one may solve the N—2 equations (34-a) 
through (34-m) for the unknowns 21, -:°, %1,v—1 1n 
terms of the variables 21,1, ¥2,1, ° °°, Yv—1, and then 
substitute into (35) the switching surface of the form 


Inen = PSs) AT; 211, ss Nt, WItR A os 


Thus it is shown how to obtain, at least in principle, the 
equation of the switching hypersurface, 7.e., the equa- 
tions of the set of points (Vi). The procedure for obtain- 
ing the correct value of A* will be developed in the fol- 
lowing section. 


THE AUXILIARY EQUATIONS FOR THE 
SWITCHING SURFACE 


Let ty_1 be the time required to go from the set 
(Vex) tos(0). 

Let ty_» be the time required to go from the set (Vy_2) 
to (Via). 

Let ty_r be the time required to go from the set (Vy_r) 
to (Vy—r4). 

Let ft: be the time required to go from the set (V1) to 
(V2). 


All times must be positive. 


Furthermore, let 
(36) 


2N=k — Xp (tv—r) 


and since each time was assumed positive, note that 
each 


gp ls. ge iotg ola ae, (3m) 


The variables (Vi) of the switching hypersurface satisfy 

the following equations: 

Ye, + A* = 2A*g1% — 2A*(2122)% + ZA*(z1Z0%3)% — - - - 
+ 2A* (2122 - + + By—4)** — 2A*(zize - - 
+ 2A*(ziz2 + + + Zy—2)** — A*(zig2 + » » By—1)** 


for N odd, k = 1,2,---,N andgz;> 1. (38) 


&; Zn—3) 8k 


The derivation of the above equation follows the same 
procedure as the derivation of (33-n). See Appendix II 
for the derivation. 

Let 


W2 = 2129 
W3 = 212223 
Wy-1 = 212223 + + + 2v—22N-1. (39) 


Substituting (39) into (38) and dividing by A*, the 
equations that the variables (V1) of the switching hyper- 


1961 Athanassiades and Smith: 


surface must satisfy are: For N odd, 


’ Sk Sk ? Ss; Sh Sk 
— + 1 = 2w, — 2we + 2wz — --- — Qwy_3+ J2wy_e 


Sk 
= UNE 


for A* = + 1,2 = 1,2 (40-a) 


for N even, 


HOGA ee ered een 22 ee! dV, (40-5) 


Note that from the restriction of positive time and 
_ from the definition of the w,, it follows that the w vari- 
ables must satisfy the following restrictions: 


Wy_1 > Wy-2 > °° * W3 > We > w, > 1. 


(41) 


The restrictions imposed by (41) will be used to deter- 
mine the correct A*. These restrictions eliminate all 
possible trajectories in negative time from the mathe- 
matical expressions. 

Eqs. (40-a) or (40-b) are the parametric equations of 
the switching hypersurface. The total number of these 
equations is NV. The total number of the w variables is 
N—1. The restrictions (41) must be satisfied. Thus, 
given an initial point (Vo), then, 


a) either the initial point is on the set (V1), that is, 
the initial point lies on the switching hypersurface, 
or, 

b) the initial point (Vo) does not belong to (Vi), that 
is, the point is not on the switching hypersurface. 


Let 
(42) 


Dele et ts OBR — Its a UN Oa UN ids 


That is, use the first N—1 coordinates of the initial 
condition point, also called the state point, in the first 
N-—1 equations given by (40-a) or (40-b). 

For N odd, since 1/A* =A* 


81 81 81 81 
A*v1,0 +1= 2w, — 2We +++ 2Wy-2 — WNn-1 


A*oy—10 + 1 = 2wy* — Qua + ++ + + Qwy—r 
ee . (43) 


Since the coordinates of the state point (Vo) are known, 
one may solve (43) in the following manner: 


1) Assume that A*= +1. 
2) Solve for wi, W2, - , WN-1. 
3) Check if the w acbics détctnined satisfy the 


restrictions of (41). 
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4) If the restrictions of (41) are not satisfied, then use 
A*=—1 and repeat steps 1 and 2. A solution will 
always exist because of the property of the switch- 
ing hypersurface’s being continuous, infinite in ex- 
tent, and separating the space into two parts. 


Thus, from (43) and from the restrictions (41) one 
may solve for w, - - -, wy_, and the correct A*. 

Since only N—1 equations out of N were used, then, 
one may use the w variables just determined and the 
correct A* in the last equation 


sN SN 
N= 2) — ead 


8N 
Ope Sante 


and (44) yields the value of vy .. 
Thus, 


a) If (Vo) belongs to (V1), then, v,,1 determined from 
(44) is such that 


A*oy.1 +1 = 2w (44) 


UN ,1 = UN,0- 
b) If (Vo) does not belong to (Vi), then, 
(45) 


UN ,1 — UN,0 = ( 


The above procedure illustrates the methods that must 
be followed in order to test if the state point is on the 
switching surface. 


THE CONCEPT OF THE DISTANCE FUNCTION 


The distance function is defined as the distance from 
the present state point to the switching hypersurface. 
This distance function has a magnitude and a polarity, 
which depends on whether the state point is “above” or 
“below” the switching hypersurface. The magnitude of 
the distance function may be the Euclidean distance 
from the state point to the hypersurface along some axis 
of the N-dimensional space or any linear or nonlinear 
single-valued function of it. 

The distance function, as defined above, has the fol- 
lowing properties: 


a) If the state point is on the switching hypersurface, 
then the distance function is zero. 

b) If the state point is not on the switching hyper- 
surface, then the distance function will have either 
a positive or a negative polarity. Due to these 
properties, the distance function may serve di- 
rectly as the output of the nonlinear computer, the 
manipulated variable m(t) of Fig. 1. 


Thus, 


a) If (Vo) does not belong to (Vi), then m/(t) is the 
distance function from (Vo) to (Vi). 

b) If (Vo) belongs to (Vi) but not to (V2), then the 
distance function is the distance from (Vo) to (V2). 

c) If (Vo) belongs to (V2), and, hence to (V1), but not 
to (V3), the distance function is the distance from 
(Vo) to (V3), and so on. 


io 


THE GENERATION OF THE DISTANCE FUNCTION 


The distance function, which is m(t), the manipulated 
variable of Fig. 1, may be defined as follows: 
Let 


m(t) = — (—1)%(ew.0 — on ,1). (46) 


Note that the output of the relay F= —A=sgn m(t). 
The relation between m(t) and the difference yy o—vyn 1 
was obtained as follows: Given a point (Vo) such that 
’v,o—UY¥ni>0, then one may find whether A= +1 or 
A= —1 will cause the trajectory to intersect the switch- 
ing hypersurface in positive and finite time. The identi- 
cal procedure was repeated for a point (Vo) such that 
U’v,o—Un 1 <0 and it was found that (46) was the correct 
relationship. 

Thus for systems described by an even-order differ- 
ential equation, if the state point is above the switching 
hypersurface (above referring to a direction along the 
vy axis), the output of the relay must be —1, while if 
the state point is below the switching hypersurface, the 
output of the relay must be +1. 

If the system is described by an odd-order differential 
equation, then if the state point is above the switching 
hypersurface the output of the relay must be +1, and 
if the state point is below the switching hypersurface, 
the relay output must be —1. 


SOME PRACTICAL CONSIDERATIONS 


In a real system, one must design a computer which 
will be able to solve (43) and take into account the re- 
strictions given by (41). This solution of the algebraic 
equations will take some small but finite time. More- 
over, since time derivatives of the error must be ob- 
tained for a high-order system, there exists noise and the 
values of the different variables are not known very 
accurately. Thus, the state point cannot be brought 
exactly on the switching surface but very close to it. 
This corresponds to the case where after the initial tra- 
jectory the following trajectories of the system will be 
close to the switching hypersurface. The distance func- 
tion will have the correct polarity but its magnitude will 
be small. Fig. 6 shows, in a block-diagram form, the 
different computations required for the generation of 
the distance function m(t). 

The output is subtracted from the input, which was 
assumed to be zero, to form the error. The error is oper- 
ated on by the ideal all-zero network and the individual 
lag networks to construct the state variables v1, v2, +: -, 
vy as shown in Fig. 5. 

The variables v1, -- +, vy_1 are used as the known 
quantities in the solution of the nonlinear algebraic 
equations described by (43) to determine the auxiliary 
variables w which must satisfy the restrictions of (41). 
The variables w are used for the calculation of the 
switching surface variable vy, according to (44). The 
difference between the computed variable vy; and the 
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NONLINEAR COMPUTER 


SOLUTION 
OF EQUATIONS 


(41) and (43) 


Fig. 6—Symbolic representation of suggested design procedure. 


remaining state variable vy,9 is used to compute the 
manipulated variable m(t) as shown by (46). The vari- 
able m(t) determines the present relay output. 

If the order of the system is small, that is, for NV =2 or 
N =3, it is possible to solve the nonlinear algebraic equa- 
tions given by (43) explicitly and to determine a cri- 
terion based upon the present values of the state point 
which satisfies simultaneously the restrictions of (41) 
and yields the correct value of A*. If this is the case, 
then the values of the w variables may be determined 
explicitly as functions of the state variable. One may 
then proceed to determine the distance function as an 
explicit function of the coordinates of the state point. 
If the system is of higher order and/or the poles of the 
system are not simple integers, then the solution of the 
nonlinear equations (43) and (41) must be performed by 
a computer in an “educated” trial-and-error fashion. It 
must be mentioned that due to the inequalities wy 4 
>Wy2>-+ ++ >We >w>iandsy>syi> +--+: >> 
>0 certain terms in (43) are much larger than others 
and this information may be used in order to determine 
a rapidly convergent trial-and-error solution. Prelimi- 
nary calculations on third- and fourth-order systems indi- 
cate that if the initial guess is w;=1, then one may con- 
verge to the true solution with 3 to 6 tries, which may 
be performed quite rapidly in a medium-speed digital 
computer. See Appendix III for computations for a 
third-order system. 


CONCLUSIONS 


The equations for the switching hypersurface of the 
Nth-order maximum-effort bang-bang control system 
have been developed. The equations of the switching 
hypersurface were developed by considering the series of 
the optimal trajectories which bring the present state 
point to zero in the minimum possible time. The as- 
sumptions used were that the optimal solution existed 
and that the origin of the phase space could be reached 
with, at most, N—1 switchings (reversals) of the relay. 

The equations that describe the relationship between 
the phase-space variables at the instant of the first 
switching of the relay were obtained in a parametric 
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form with a nonlinear function of time acting as the 
parameter of the equations. From the equations of the 
switching hypersurface, a convenient mathematical 
measure was obtained, the distance function, which de- 
scribed the position of the state point with respect to the 
switching hypersurface. 

The main contribution of this paper is that the exact 
mathematical operations and computations that must 
be performed by the computer have been exactly speci- 
fied. No memory about the previous behavior of the 
system was assumed and no feedback from the output 
of the relay was used in the mathematical computations. 
The latter is especially important in the stability of the 
system, because although the present output of the 
relay may be incorrect, the correct distance function of 
the system is applied to the relay such that the relay 
output is forced to its correct value. The concept of the 
switching curve for second-order systems has been used 
extensively before. The concept of the switching surface 
has been used®:'*:17:19 only for special cases. The scope 
of this paper was to extend the available theory to an 
arbitrary-order linear system and to use the integrated 
concept of the switching hypersurface and of the dis- 
tance function for the actual design of a time optimal 
control system. 

The theory and method of design presented may be 
extended to the case in which the terminal point is not 
the origin, but is any other arbitrary point in the phase 
space.”° Only the equation of the final trajectory need 
be modified to include the coordinates of the terminal 
point, provided the system is controllable. 

If the input to the system is not zero, for example, 
the input may be composed of steps, ramps, and other 
polynomial-type terms; then, the equation of the 
switching hypersurface will depend on the present and 
predicted value of the input function and of its deriva- 
tives. Identical linear transformations may be per- 
formed on the error variables; however, the nonlinear 
algebraic equations which describe the switching hyper- 
surface will include not only the coordinates of the state 
point but also some transformed variables of the input 
function.”° 

Furthermore, in the case of inputs, the system itself 
must be controllable, that is, the inputs must be limited 
to those that the system can follow without any steady- 
state error in a finite transient time.”° 
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DERIVATION OF THE v VARIABLES 
Consider (22) 
4, (t) = — $jX; a bjnA. 


190. J. M. Smith, “Feedback Control Systems,” McGraw-Hill 
Book Co., Inc., New York, N.Y.; 1958. 

20 M. Athanassiades, “Theory and Design of Bang-Bang Control 
Systems,” Ph.D. dissertation, University of California, Berkeley; 
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Neos) 
Take Laplace transforms 
sxj(s) = — s,a,(s)+bjAls) (48) 
(s + sj)x,(s) = bin A(s) 
byw A (s) 
iS) (49) 
(Ss ++ $j) 
But from (24) 
, 
v;(s) = «;(s) ms 
() = —— als) 
*. dj(s) = == (NS). (50 
; (Sit 57) 
But from (5) 
(GS 
A(s) = — ©) 
G(s) 
(s) — (3) (51) 
7. v,(s) = — Ss). 
BOM esas) 
This operation is shown in Fig. 5. 
APPENDIX II 
DERIVATION OF THE EQUATIONS OF THE 
SWITCHING HYPERSURFACE 
The set (Vy_1) is described by the equation 
O = (%,n-1 — A*)e~sn-1 + A* 
or 
U.N = — A*esktn—-1 At R= ik Bono N. (52)n—-1 
The set (Vy_2) is described by the equation 
Ue,.N—-1 = (e,w—2 + A*)e—*v-2 — A* 
or 
Oj 2 =" Oe pee) Oe ate BAS (52) n—2 
The set (V;) is described by the equation 
9 —wlth, be Je AS 
or 
V1 = (Yeo + A*)er*tt — A*, (52)4 
Using (36) 
%,.N-1 = — A*zy_1 + A* (53) w=1 
(47) Ve,N—2 = (%,w—1 + A*)en—2 iN (53) v—2 
ty = (ee + A") ey — AGS iVodd ieu=ahs ss ave (53)1 
By successive elimination of the v%,”—1, U%,v—2, + + vari- 


ables, equation (38) is obtained. 
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APPENDIX III 


EXPERIMENTAL RESULTS FOR A THIRD-ORDER 
SYSTEM 


Let N=3. Then the switching surface satisfies the 
equations 


A*o,1, + 1 = 2wi — wes! (S4) 
A*vo.14 + 1 = 2wi*? — we*? (S5) 
A*v3., + 1 = 2w 153 — we’ (56) 
and 
We > Wi > 1; Sy saa sy 0: ee) 


Given v;,1 and v1 one may solve for v3. Therefore, one 
needs to solve only (54) and (55). 

If w; is chosen then one may solve for we from (54). 
Define an error 


Fie 2w,*2 = YEA (A*v. 1 + i) (58) 
If H=0, then the wz, chosen is the correct one. 
From (58) 
OE OW, 
— = 250w 1°?! — Sows? 1 (59) 
OW, Ow 
But from (54) 
OW2 
$198! —— = 25, 81-1, (60) 
OW, 
Substituting in (59) 
OE 
—— = 2sqw ys?! — 2sqwe'? (wy! !/wet 1) (61) 
OW, 


If w.>w; and so>s; then 


Or 
=—— <0 


ot (62) 


independent of A*. 

Based on the above result it was found that the fol- 
lowing computational procedure converges to the true 
value of w; and wp». 


1) Assume A*=sgn 711. 

2) As an initial choice for #1, say wi, choose wip = Weo 
such that wy = (A*v,1+1). 

3) Solve for win and wy = wo. 

4) Substitute wio and we in (58) and evaluate Ep, 
where Ey = 2W49°? og (A Fo i+ ig. 
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5) If Eo is negative then the choice of A* is wrong. 
If Eo is positive, the choice of A®* is right. If Eo 
is negative then an increase in the value of Wyo will 
result in larger negative error and the process 
would diverge. 

6) If the error Eo is negative, change the value of A* 
found instep 1) byits negative. Then assume that 
W190 = il. 

7) Change wip by an increment based in some esti- 
mate of the slope of the # vs w, curve near zero 
error. 


It was found that the above iterative process is eff- 
cient and that the number of iterations required to de- 
termine w, and we, with good accuracy, ranged between 


3) aaa! 7, 


Three sample calculations are shown below: 


Example 1 
SS Sas 
U1= 2.0 na = = 5.0 
Wy We E AAS 
1st iteration 2.4981 2.4981 9.1962 1.0 
2nd iteration 4.6051 6.5281 5.9686 
3rd iteration 5.6962 8.5503 2.2261 
Ath iteration 6.0679 9.2349 0.6721 
5th iteration 6.1770 9.4355 0.1896 
6th iteration 6.2076 9.4916 0.0527 
Example 2 
Si 2 $3 = 138 
U1 = DE) Uo." 20.0 
W We E AS 
1st iteration 2.4981 2.4981 24.1960 1.0 
2nd iteration 8.0421 12.8460 5.2207 
3rd iteration 8.7846 14.1960 0.3843 
4th iteration 8.8369 14.2910 0.0264 
Example 3 
Ss = 122 AY ited O22 
wi =—5 V1 = — 5 
Wi We E As 
1st iteration 4.4510 4.4510 112.8700 —1.0 
2nd iteration 5.8566 7.1970 127 O27 
3rd iteration 5.9324 7.3425 0.3845 
4th iteration 5.9346 7.3466 0.0127 


A third-order system with:s;=1.2, s.=1.8, s3=2.2, 
was simulated on a Bendix G-15 computer. The experi- 
mental results were in accordance with the theory. 
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Model Feedback Applied to Flexible Booster Control’ 


G. E. TUTT{ ann W. K. WAYMEYER}, MEMBER, IRE 


Summary—The problem of the filtering of elastic phenomena 
(bending and sloshing) from space booster-control feedbacks has 
become increasingly difficult as bending frequencies approach con- 
trol frequencies in large vehicles. The design problem is compounded 
by the loop-gain requirements for control of an aerodynamically un- 
stable airframe in a dynamic wind environment. 

This paper presents a “model feedback” approach to this design 
problem in which the system does not attempt to “adapt” to body 
bending, but instead is contrived to ignore it. The vehicle-body feed- 
backs, required for stability and control, are synthesized by a com- 
bination of actual body motion and information from a model of the 
rigid body acted upon by the control force. 

Following an investigation of stability and response for this sys- 
tem, attention is focused on the problem of response to disturbances 
such as wind, gusts and shear. 


INTRODUCTION 


HE fundamental control problems in the design of 
"| aexiti space-vehicle boosters center around the 

control of an aerodynamically unstable airframe 
in a dynamic wind-shear (jet stream) environment. The 
control-loop gains required to prevent tumbling are 
usually high enough to make the filtering of bending 
and sloshing feedbacks difficult. As the structural efh- 
ciency of the tankage is improved and the body-bending 
frequencies approach the controlled airframe frequency, 
new approaches to control design are needed. A com- 


mon suggestion is that “adaptive” control systems 
should be developed to cope with this problem. In this 
paper, a feedback-model approach to this design prob- 
lem, which shows promise, is outlined in some detail. 
This approach does not adapt to body bending, but in- 
stead is contrived to ignore it. 

The designer’s knowledge of thrust, vehicle weight, 
moment of inertia, and aerodynamic characteristics is 
usually quite good. The approach developed here does 
not preclude, however, a desire to know them better, or 
to “adapt” to them as the booster rises through the 
sensible atmosphere; rather this approach is concerned 
with the control of the nonrigid-body aspects of the 
vehicle. For the case in which the rigid body parameters 
are not well known, adaptive techniques might be ap- 
plied for their identification and incorporation. 


CONVENTIONAL SYSTEM 


The conventional method of booster control is a 
proportional attitude control system with rate feedback 
for rigid-body stability, and control force derived from 
gimballing a thrust vector. The problem then is to de- 
sign compensation and set gains, such that nowhere in 
flight will a rigid body or resonance instability occur. 
Fig. 1 shows this type of system as used in a typical 


K4a=1.37° Kr = 0.563 

Km = 14.7 Msp = 4.76(¢ = 
= §.53(¢ = 

Ka = t ) 


0.85 Ma = 


0¢= 
3.06 (£ = 60 seconds) 


Gi 48.9 
OQ:  S? +.0.343S + 600 


0) 
60 seconds) 


res 97.9 
Qo  S?-+0,6695 + 1120 


Fig. 1—Conventional autopilot showing some typical gains. 
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Thor space booster. The block diagram shows two 
modes of body-bending and aerodynamic effects, simpli- 
fied to ignore lateral motion components. The vehicle 
dynamics are thus simplified to include only one im- 
portant nonrigid-body effect (uncoupled bending of the 
airframe), so as to avoid complication which would not 
be pertinent to a demonstration of the basic model-feed- 
back principle. Although propellant sloshing is a very 
important effect, there exist methods of stabilization 
(baffles) which do not require major changes in the air- 
frame itself. Consequently, as presented here, the em- 
phasis is placed upon control of the vehicle body bend- 
ing. The feedback blocks are shown as functions of S to 
indicate the existence of some form of compensation. 
Command and disturbance transfer functions are, re- 
spectively : 


AUTOMATIC CONTROL May 

Clearly the amplitude and phase of the bending feed- 
back will depend upon the slope of the mode (m) at the 
instrument location ¢,'(X7), and the characteristics of 
the compensation asa filter at the modal frequency. The 
filters cannot efficiently reject the lower bending-mode 
frequencies if these are close to control frequencies, since 
a rejection of control frequencies would impair system 
response. 

MopEL FEEDBACK 


The idea of a model feedback system is to allow heavy 
filtering of the bending frequencies, while the rejected 
rigid-body information is returned to the feedback via 
a model of the rigid body only. Of course, very low- 
frequency elastic-body information is retained to main- 
tain long-term attitude accuracy. This basic configura- 
tion is shown in Fig. 2, where it can be seen that the 


Ia IR ae M 53(S) 
Op 7 Seen: Ss 
ie Ue Ras M3,(S MidS) ORS 
fe 2) (KS) + aS) 05) 4 oB(S) —) 
) sy Sy 
and 
M;;(S) 
bs S) 
ba 5 M33(S) Kw(S) ( Ka(S) 
KRr(S 
: S Ku Kp(S) es ) 
ee ee 
S J 
where 


Gy G2 S 
M;,(S) = (40 + o1(Xx) —S?b1'(X1) + b2(Xxn) — sex) | 
1 Qo S 


ENGINE SERVO 


BODY DYNAMICS 


Fig. 2—Basic model feedback system. 
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engine position 6 operates upon the vehicle-control 
moment effectiveness M;5,(s) and upon a model of the 
vehicle as a rigid body, M;*. Thus the total rigid-body 
feedback would be approximately as before, with a high 
rejection of body bending. 

This approach depends upon a knowledge of the rigid- 
body control effectiveness (thrust, moment of inertia, 
c.g. location, etc.), all of which are usually predictable 
for a space booster. The assumption made for the basic 
system of Fig. 2 is that all vehicle angular motion arises 
from thrust vector deflection as measured at the engine 
position instrument. This is strictly true, of course, 
only for the nondisturbance, zero g (dynamic pressure) 
condition. 

Fig. 3 shows the MF (model feedback) diagram parti- 
tioned as for the conventional system, with the addition 
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It may be seen from the transformed engine-feedback 
function that the inclusion of M,* in the model system 
is required for aerodynamic stability at any appreciable 
levels of M.. The reason for this is that deletion of the 
M.* term would cause the model to revert to M;*, in 
which case the de gain of the transformed engine feed- 
back would become 


Kr K, 
Kat Me (= 4 ‘). 
(6) Ww 


Quantitatively, if w were 2 radians per second, for 
example, using the gains from Fig. 1, this function would 
then be about four times greater than Kg alone. The 
resulting drop in de control gain (6/6) would produce a 
closed-loop pole in the right-half S plane when 


of a model of the aerodynamic moment effectiveness. ite coile Ka 
The command and disturbance transfer functions are: € 
Ka Ku / Mizg(S)S 
Op Sabb)! ( — 7 
aay Ge ee Kells RS ee ae hari So DK ns (Se ) Ke KOS bes) 
ABE S Ss eee oe oe (S -- w)? — M.* | 

M3,(S)S M3;(S)Ku J oi (= +w)+ =|} 

bs EET? ey \ia eos lan Saue ea 

ae %, Same Denominator as Above 


where M;,(.S) includes the bending terms. 

Comparing this command transfer function with that 
for the conventional system suggests that the MF block 
diagram could be rearranged to appear like that for 
the conventional system. If this were done, the engine 
feedback would be transformed to 


Kr(S +o) + =] 
(S + w)? — M* |’ 


1 Giga ue] 


while the rate and attitude feedbacks would have multi- 
pliers involving only the filter frequency (w) and the 
model parameter M,.*. 


ae 


However, it is not possible for M,* to operate upon 
only computed information, since a closed-loop pole- 
zero pair would appear in the right-half plane and these 
would cancel only if M,.*= M, exactly. Hence, one gets 
the configuration shown in Fig. 3, where M,* is acted 
upon by the combination of computed and actual body 
position (using the simplifying assumption that 6=a). 


COMPARISON WITH CONVENTIONAL SYTEM 


A direct comparison, in terms of stability and re- 
sponse, will now be made between the conventional sys- 
tem of Fig. 1, and the MF system of Fig. 3. The same 


Fig. 3—Model feedback with two bending modes. 
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gains and bending dynamics were used for both, with 
the first- and second-mode bending frequencies at 3.9 
and 5.3 cycles per second, respectively. 

Nyquist diagrams of the conventional 63/6; character- 
istic function are plotted in Figs. 4 and 5 for two flight 
conditions. For Fig. 4 the rate and attitude gyros were 
well forward of the first mode antinode, while for Fig. 5 
they were well aft. These conditions might correspond 
to times early in flight and late in flight, respectively. 
The corresponding Nyquists for the MF system are 
Figs. 6 and 7. It can be seen that while a bending in- 
stability occurred in the conventional system when the 
bending-mode shapes changed with respect to the in- 
strument locations, no such problem was encountered in 
the MF system. As expected, bending rejection was high 
in the MF configuration. 

The response to commands (in the form of step rates) 
is shown for both the conventional and the MF systems 
for a liftoff condition (no aerodynamic forces) in Fig. 8, 
and for a region of flight near the maximum gq in Fig. 9. 
These plots show that response has not deteriorated 


Fig. 4—Nyquist plot of conventional system—first flight condition. 


let 
a 


{ 
PN Kade 


Fig. 5—Nyquist plot of conventional system—second flight condition, 
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with respect to the conventional system, which is not 
surprising, since rigid-body feedback is essentially the 
same when M;= M;* and M,=M.*. 

A comparison of disturbance response is made by 
introducing a step 2660-pound force at the gimbal loca- 
tion for each system. The comparative responses are 
shown in Fig. 10 for M,=0 (no aerodynamics) and in 
Fig. 11 for M,=3.06 (maximum q). 

A very poor response to disturbances is thus evident 
for the MF system, as was to be expected, since body 
motion is not generated solely by engine position. In this 
case, the engine responds only to information passed 
through the heavily-filtered real body loop. 

For the plots of MF response at M,=3.06, a mapping 
of the closed-loop roots is shown in the lower right 
corner. In the case of the command transfer function, 
the pole at 0.25 is cancelled by a zeroif Ma= M4", leav- 
ing the dominant roots to be the conjugates shown. The 
effect of this “high time-constant” pole depends then 
upon how close M,*is to Ma. No such cancellation exists 
for the disturbance transfer function, however (see Fig. 
11), and the pole at 0.25 becomes a dominant root, hence 
the slow response. Figs. 12 and 13 show command re- 


Fig. 7—Nyquist plot of model feedback—second flight condition. 
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Fig. 11—Rate response to step-disturbance force—maximum 
q condition. 


Fig. 13—MF command response with M,*=15 per cent 
greater than My. 
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Fig. 10—Rate response to step-disturbance force 
(2660@Xzx) for the liftoff condition. 
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sponse for M,* 15 per cent less than M,, and 15 per 
cent greater, respectively. These plots show that toler- 
ances placed on M,* (with respect to M.) should be 
heavily weighted toward the positive (M.*>M,). In- 
deed it might be well never to allow M.* to become less 
than M,. 


MODIFICATIONS FOR DISTURBANCE. RESPONSE 


Clearly some sort of modification to the MF system 
is required if anything but very low-frequency disturb- 
ances are to be tolerated. If no disturbances were an- 
ticipated, or if their fundamental harmonic component 
were below the filter-break frequency, then of course 
the system is adequate as it stands, and a logical sim- 
plification would probably be removal of the rate gyro. 

Since, for booster flight through the atmosphere, the 
origin of disturbances is known to be aerodynamic, two 
additions to the basic MF system based on a-meter 
feedback will be mentioned. The problem is to obtain 
some sort of disturbance information without re-intro- 
ducing the bending which was previously rejected. The 
first method involves the measurement of the angle of 
attack by a suitable a meter, and a combination of this 
with an approximate a as generated by the model loop. 
This is depicted in Fig. 14, which shows an expansion 
of the basic model to include lateral-motion terms which 
effect a. The idea here is that some portion of the initial 
disturbance information will be affected only by the 
filter, rather than the added integrations of body mo- 
tion, and hence, better feedback signals of the disturb- 
ance will be provided. 

To observe the response of this configuration, a step- 
wind velocity was applied (for the case of M.=3.06) 
such that the disturbance moment on the vehicle was 
the same as for the step 2660-pound force at the gimbal 
location. This velocity (58.7 feet per second) produces 
an initial a of 1.81°, hence initially 


deg/sec? 


6-= (1.81°) x (3.06 ) = 5.53 deg/sec?. 


eg a 
This is the same as the previously applied moment, 
which was equivalent to 1° of engine deflection (2660 
pounds at Xz). Fig. 15 shows that a significant improve- 
ment in disturbance response was obtained by addition 
of this low-frequency angle-of-attack information in the 
feedback. No significant change in bending relative sta- 
bility would occur from this, since K, was chosen such 
that Ky’=K,.+Ku, where K,’ is the attitude loop gain 
previously used. 

Thus it is demonstrated that a significant improve- 
ment in control-system response to disturbances (wind) 
is obtained when the angle of attack (in addition to 
inertial attitude) is fed back. This improvement, though 
significant, may not be good enough, as high-frequency 
information is filtered from the angle-of-attack data in 
order to suppress the sensing of structural vibration. 
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Fig. 14—Attitude angle-of-attack model feedback system. 
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Fig. 15—Disturbance response showing the effect 
of a, feedback. 


A SEcoND METHOD 


It is therefore clear that a method of sensing the 
angle of attack (or the equivalent) without sensing 
bending would be of real value, since it would permit 
immediate recognition and feedback of wind inputs. 

To explore how this might be done, the content of the 
acceleration, attitude rate and angle-of-attack trans- 
ducer measurements is investigated for instruments 
mounted at the nose of the vehicle (Fig. 16). 

The accelerometer measures the lateral acceleration 
of the center of gravity caused by aerodynamic forces 
(N,a) and by the deflected thrust (V3). In addition, it 
measures angular acceleration of the vehicle in propor- 
tion to its distance from the c.g. (1/18456) and oscil- 
latory acceleration due to the bending of the airframe 
$i/32.2X,. The angle-of-attack meter measures the 
direction of motion of the vehicle nose with respect to 
the local wind 


LS, 
eg og SE a 
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Fig. 16—Simplified dynamics to obtain 6, a and N, of the vehicle as 
measured at the nose. 
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Fig. 17—A method of obtaining a@ (free of bending) to include 
wind inputs. 


and is affected by body bending in two ways. Lateral 
velocity of the nose due to bending is interpreted as a 
change in local wind direction (57.3¢’/UX,) and angu- 
lar displacement of the vehicle nose because of bending 
(X nd, 57.3) is also sensed as an apparent rotation of the 
wind velocity. A device from which attitude rate at the 
nose is derived will sense bending (¢,'57.3X x) also. 

It is true that the bending modes and frequencies are 
not always well known, and that the model feedback 
control presented in this paper is intended to eliminate 
any requirement for precise information in this area. It 
is, therefore, important to note that the bending sensed 
by the accelerometer is common to one component of the 
bending sensed by the angle-of-attack meter, except by 
a known constant and missile velocity. Similarly, the 
bending sensed by both the attitude-rate device and 
the angle-of-attack meter is the same. 

These facts then suggest that bending information 
extracted from the accelerometers and rate instruments 
can be used to cancel bending information in the angle- 
of-attack data. Fig. 17 represents in block diagram form 
the concepts involved in this operation. Use is made 
of techniques presented in earlier sections. In essence, 
the technique is this: 1) Determine rigid-body rate and 
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acceleration at the nose by a combination of techniques 
presented earlier, 2) subtract measured quantities from 
synthetic quantities, 3) subtract the difference from 
measured angle of attack, obtaining bending-free angle- 
of-attack information. 

If the resulting a information is then used as an im- 
proved angle-of-attack feedback (as compared with 
that of Fig. 14), it is expected that the desired response 
to all forms of disturbance would be obtained. 


CONCLUSIONS 


To apply the concepts presented here to the control 
of a particular vehicle, certain quantitative aspects 
would require investigation. These include: 1) the deter- 
mination of which model parameters are actually re- 
quired in the model, 2) the sensitivity of the model 
parameter values to system performance, 3) determina- 
tion of the most practical method of keeping the model 
parameter values within the required tolerances with 
respect to corresponding vehicle parameters, 4) for a 
particular vehicle and mission, the determination of the 
simplest and most practical form of a feedback for ade- 
quate response to the disturbances to be encountered, 
and 5) selection of a suitable filter frequency (w) to 
give the required rejection of body bending. 

A system has been derived, then, which virtually 
eliminates the possibility of a bending-mode instability 
even for wide variations in modal parameters, while 
maintaining the desired response to commands. This 
has been done at the expense of adding some complica- 
tion to the system, in the form of model and a-feedback 
loops. It is also required that certain vehicle rigid-body 
dynamic parameters be identified, either during or pre- 
vious to flight. However, in the design of a conventional 
control system, these dynamic parameters must be de- 
termined as well as the less readily obtainable bending 
parameters. Also, the compensation networks for the 
conventional systems could well be more complex, com- 
ponentwise, than the MF model configurations. 


SYMBOLS AND NOMENCLATURE 


Fy = High-pass filter 

F,=Low-pass filter 

K4=Attitude feedback gain 

Kr=Rate feedback gain 
Ky= Engine servo forward gain 

Ka=Engine servo feedback gain 
M;=Control moment effectiveness 

M,= Aerodynamic moment effectiveness 
N;=Control lateral acceleration effectiveness 
N,= Aerodynamic lateral acceleration effective- 

ness 
U=Vehicle velocity along the flight path 

N,= Lateral acceleration 
c.g. = Center of gravity 
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/= Moment arm length 
K,=Angle-of-attack feedback gain 
S = Laplace variable 
*— (Superscript) denotes a rigid-body model 
parameter 
I= (Subscript) denotes a variable as measured 
at the instrument location 
c= (Subscript) denotes a computed variable 
u = (Subscript) denotes variable obtained from 
combination of actual and computed vari- 
ables 
B= (Subscript) denotes actual body variables or 
parameter 
d= (Subscript) denotes a disturbance variable 
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6 = Body-attitude angle with respect to the gyro 
reference 
5= Engine deflection angle with respect to the 
body centerline 
a= Aerodynamic angle of attack 
y=Flight path angle 
gn(Xm) =Relative deflection of bending-mode # at 
location m 
dn’ (Xm) = Relative slope 
Wn = Natural frequency of mode n 
¢ = Damping ratio 
X= Deflection of station m in bending with re- 
spect to the rigid-body centerline 
7, = Lateral component of wind velocity. 


Terminal Control System Applications’ 
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Summary—tThis paper describes a synthesis procedure for ter- 
minal control systems. The synthesis procedure is illustrated by ap- 
plication to the design of an aircraft automatic landing system. 

A simplified model for the landing aircraft is chosen and justified. 
The prediction equations for this model are discussed. 

Using the prediction equations, a two-condition terminal control- 
ler, which controls the altitude and altitude rate at time of touchdown 
to the desired values, is developed. 

The terminal control landing system developed is simplified by 
combining feedback loops in a straightforward fashion to arrive at a 
practical mechanization. A stability analysis of the simplified ter- 
minal controller, considered as a servo with time variable gains and 
time constants, is presented. 

The results of extensive analog computer simulation and flight 
test of the terminal control landing system developed in this paper 
are reviewed. It is shown that the synthesis procedures developed in 
this paper result in a system which can be implemented by state-of- 
art hardware to land aircraft successfully. 


I. INTRODUCTION 
\ TERMINAL control system is one which con- 


trols the system state variables to specified 

values at some fixed, terminal time in the future. 

The concept of terminal control is based on the simple 

fact that if the initial conditions of a system with known 

differential equations of motion are specified, then the 

future response of the system can be predicted in the 
absence of disturbances to the system. 

The terminal controller can be so designed that the 

system approaches the final state from the initial state 


* Received by the PGAC, December 15, 1960; revised manuscript 
received, March 15, 1961. 
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in a desirable fashion. The desired final state is attained 
by exercising continuous control and continuously pre- 
dicting the terminal conditions. Therefore, the system 
is controlled to the desired final value of the output 
variables even though disturbances occur. Appropriate 
control action is initiated to ensure at all times that the 
predicted terminal conditions match the specified ter- 
minal conditions. 

The principal application of terminal control systems 
has been to automatic landing flare systems for aircraft. 
A number of system approaches have been employed for 
automatic landing of aircraft. These various approaches 
fall generally within three categories: 


1) Altitude Rate Commanded as a Function of Alti- 
tude. 
The exponential flare, wherein altitude rate is 
commanded proportional to existing altitude, is 
the simplest and most prominent system of this 
category, in which longitudinal range of the aircraft 
path is ignored. 

2) Fixed Path. 
Here the aircraft is controlled to follow a preset 
altitude-range trajectory. 

3) Terminal Controller. 
Here the values of sinking rate and altitude at a 
particular time (corresponding to termination of 
flare) are predicted and controlled to acceptable 
values. This concept has the advantage of effect- 
ing some control of range by virtue of direct con- 
trol of total flare time, without the attendant dis- 
advantage of extending the control effort neces- 
sary to follow a preset trajectory throughout the 
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flare. As a result of this requirement for less con- 
trol action to achieve the desired results, it follows 
that recovery from disturbances is enhanced, thus 
minimizing resulting dispersions in terminal con- 
ditions. 


It is the authors’ experience that, of these various 
landing system approaches, the terminal controller 
landing system exhibits the greatest tolerance to dis- 
turbances and other off-nominal conditions. The net re- 
sult is that the dispersion in the touchdown point and 
the sinking rate at touchdown is less than for the com- 
peting system approaches. It is also the experience of 
the authors that the terminal control landing system is 
considerably easier to fly manually than the competing 
systems when the pilot operates as a servo to maintain 
the terminal control system error zero. 

Early investigations into terminal control concepts 
were initiated in early 1955 at the Massachusetts Insti- 
tute of Technology Dynamic Analysis and Control 
Laboratory.* A large number of publications were 
made in which the prediction theory was developed and 
techniques for exercising terminal control were syn- 
thesized and analyzed. Shortly after this beginning, theau- 
thors and their colleagues at Autonetics initiated a pro- 
gram organized to develop further the basic concepts of 
terminal controllers and to apply these developments to 
practical control systems. The Laplace transform meth- 
od of solution of the aircraft differential equation of 
motion was introduced by this group, supplementing 
the time domain analyses previously employed. The 
frequency domain approach was found to be more 
meaningful to control system engineers, and it pointed 
the way to various simplifications in the control system 
development. 


II. PREDICTION EQUATIONS FOR LANDING AIRCRAFT 


The first step in the synthesis of terminal control sys- 
tems is to develop prediction equations for the system 
to be controlled. These prediction equations represent 
the time solution of the system differential equations. 
The time solutions are written as a function of a fixed 
time in the future 7 by a time translation. The form of 
the prediction equations is a sum of products of the sys- 
tem state variables at the time ¢ and weighting functions 
which are functions of the difference between the present 
terminal time ¢ and the terminal time 7. The exact 
definition of weighting functions used in this context 
will be deferred until later. 

It is important to simplify the mathematical model of 
the system to be controlled. The degree of simplification 


1M. V. Matthews and C. W. Steeg, “Terminal Controller Syn- 
thesis,” presented at Princeton Symposium on Non-Linear Control 
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systems,” Proc. Polytechnic Institute of Brooklyn Symp. on Non- 
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Constraints,” M.S. thesis, Elec. Engrg. Dept., Mass. Inst. Tech., 
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must be consistent with the physical process involved. 
The complete differential equations representing a land- 
ing aircraft involve several simultaneous differential 
equations. The number of state variables is large and in- 
cludes the following variables and their derivatives: 
pitch angle, altitude, velocity, flight path angle, and 
elevator deflection. The prediction equations required 
to define the system completely at the terminal time 7 
would involve a large number of weighting functions 
and a large number of prediction equations. The method 
for obtaining terminal control equations for a generalized 
system with a number of simultaneous differential equa- 
tions and a number of dependent variables is described 
in Appendix I. A straightforward application of the 
methods described in Appendix I to the complete differ- 
ential equations describing the landing aircraft would 
result in a system too complex to be practical. There- 
fore, it is advisable to look for methods of simplifying 
the mathematical model of the landing aircraft before 
proceeding. 

Often in the case of systems with many degrees of 
freedom the system can be characterized by some 
dominant mode (one or two characteristic roots) of the 
system. The system response to input commands and 
disturbances is largely dominanted by the characteristic 
roots of this mode. Asa result the complex system can 
often be approximated by a simple second-order system. 

It can be shown for the case of the landing aircraft 
that, if a high gain altitude rate loop is closed around 
the aircraft-autopilot combination, a simple mathe- 
matical model results. Fig. 1 shows a block diagram 


: ; és f 
. h ww h h 
h us h 
e (8 +2f0,) 


Differential Equation 
dh ah dh : 
ee + Aone + On’ on = wr2he(t) 


where: 
h=altitude 
¢=damping ratio 
. ®,=angular natural frequency 
h(t) =forcing function (altitude rate command) 
=independent variable (time) 


Fig. 1—Altitude rate feedback loop. 


which represents the dynamics of the landing aircraft 
with the altitude rate loop closed. This control loop en- 
sures that the response from altitude rate command to 
altitude rate is that of a simple second-order system 
and can be considered uniform throughout the landing 
flare. The differential equation describing the block dia- 
gram is also shown in Fig. 1. This differential equation 
from altitude rate command to altitude is a third-order 
differential equation with constant coefficients as de- 
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fined in Fig. 1. The prediction equations are obtained 
from this third order differential equation in Appendix 
II. The results of this development are summarized in 


(1) and (2); 
A(T) = h(t) + A(O)[T — t] + AFT — 2) 
et AE ra kW O ER 7)) (1) 
A(T) = h(t) + h@)Gi(T — td) + h()Gi(T — 2) 
+ hoGi(T — 0). (2) 


Eq. (1) is the predicted value of the altitude at the 
terminal time 7. This predicted value of altitude is in 
terms of the values of system variables existing at the 
present time ¢. These current variables are multiplied by 
weighting functions which are functions of the differ- 
ence between the terminal time 7 and the present time ¢. 
These weighting functions depend upon the character- 
istics of the system shown in Fig. 1. Analytical expres- 
sions for these weighting functions are presented in Ap- 
pendix II. Eq. (2) is a similar expression for the altitude 
rate at the terminal time 7. 

In Section III the prediction equations are mech- 
anized to form a terminal controller for the landing sys- 
tem. As will be shown, the weighting functions in (1) 
and (2) are time-variable gains on various feedback sig- 
nals. 

In a practical landing system the terminal time 7’ is 
determined during the system design. The automatic 
flare system begins to control the aircraft at some initial 
conditions of altitude and altitude rate. A nominal 
time is chosen for which the aircraft can be reasonably 
landed from the terminal conditions. There are certain 
physical constraints involved in determining the time 
required to land the aircraft in a satisfactory manner. 
This nominal time is best determined from analog com- 
puter simulation of the landing aircraft. This nominal 
time of flare then defines the terminal time 7. 


III]. CONTROLLER EQUATIONS AND 
MECHANIZATION 


The application of the prediction equations to control 
system synthesis is considered in this section. One of the 
quantities in the system differential equations must be 
the system control input. In the landing system equa- 
tions of the previous section, the control input is the 
altitude acceleration command, h(t). It is thus possible 
to determine from (1) the value of that control input 
which, if held constant during the extrapolation period 
(t to 7), would result in the desired value of the con- 
trolled quantity at 7. Since in the system described in 
the previous section, /,(¢) is the control input, (1) may 
be solved for /,. (It may be recalled that the form of (1) 
was derived using the simplifying assumption /,=con- 
stant.) Thus the proper controlled parameter value at 
T (h(T)a) can be obtained by establishing /, at this com- 
puted value and holding it there until time 7. This 
mode of control shall be termed a type-A terminal 
controller. A block diagram depicting this control con- 
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figuration is shown in Fig. 2. It will be noted that this 
method is not valid in the event Fj, passes through zero. 
| Note: Inasmuch as system variables have the argument 
(t), and weighting functions have the argument (J7’—2), 
these arguments may henceforth be omitted for brevity, 
e.g., h=h(t) and Fy=Fi(T—2). | 


CONTROLLED 
SYSTEM 


Fig. 2—Type-A terminal altitude controller. 


Another approach to the control problem is to assume 
the control variable is zero and compare the desired 
value of the controlled parameter at 7 with that value 
determined from the prediction equation. This error can 
then be multiplied by a high gain to become the control 
variable. For a theoretical discussion of such a system 
carried out in detail see R. K. Smyth.* The authors 
show that the error signal decreases monotonically 
to zero in such a system and remains there unless the 
system is later disturbed. It is also demonstrated that 
if the system gain is increased to infinity, the system 
will remain stable, the error will be reduced to zero 
in minimum time, and there will be no error overshoot. 
In actual mechanizations, however, moderate gains per- 
form adequately and simplify equipment requirements. 
A system utilizing such a control method will be re- 
ferred to as a type-B controller. A block diagram show- 
ing this control technique is presented in Fig. 3. 

Either of these two control techniques can be used to 
control one condition, e.g., either or h at t—T. Under 
these circumstances, such a system is referred to as a 
“one-condition terminal controller.” However, it is fur- 
ther possible to control two terminal conditions simul- 
taneously, in which case the system is termed a “two- 
condition terminal controller.” The block diagram of 
Fig. 4 illustrates the mechanization of such a system, 
utilizing both type-A and type-B controllers, to control 
terminal values of both / and h. 


*R. K. Smyth, “Inertial Rate of Descent System,” Proc. IRE, 
ARS Spring Tech. Conf., Cincinnati, Ohio, pp. 1-14; April, 1960. 
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Fig. 4—Two-condition terminal controller landing system. 


The system operation may be described as follows: 
The inner loop acts as a type-A controller, 7.e., it con- 
tinually computes and feeds back the necessary he, 
which, if held constant until t— 7, would result in ob- 
taining the desired (7). 


Z ete p 
iste a [i(T)a — h — hay — h.Gi,] (3) 


he 


where h(T)a is the desired value of sinking rate at the 
terminal time. Closed around this loop is a type-B con- 
troller. The output of the 4(7) predictor, which also 
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uses /, as an input, represents the error between the 
predicted and desired values of h(T). This error hess 
fed back with a high gain (limited) to form heeecis 
tending to drive the error to zero. 

hep = K|h(T)a —h—h lve — t — AF; — hy, VE heFi,,| (4) 
where h(7)a is the desired terminal altitude. Since this 
error goes rapidly to zero, the resulting configuration is 
that the control variable /, is made up entirely of the 
constant he, with h.(7) (and therefore h.g) equal to 
zero. In the absence of additional disturbances, the sys- 
tem will then arrive at t= 7 with the desired values of 
both h and hk. Any system disturbances will cause 
changes in /,4 and hz, but the system will quickly come 
to rest at a constant value for h.(=he,), where both the 
h and h predictors are satisfied. 

The value of feedback gain K is determined in prac- 
tice from analog computer studies by gradually working 
down from high-gain values until further reduction re- 
sults in discernible differences in system response. The 
resulting gains thus determined have been found ac- 
tually to be only moderately high. 

Up to this point, a formal synthesis procedure has 
been applied to the development of the terminal control 
landing system which has resulted in the configuration 
shown in Fig. 4. It is now possible to consider this con- 
figurarion as a feedback control system and combine the 
feedback paths in such a way that a significant sim- 
plification in the system results. The simplifications will 
be discussed in Section IV. 


IV. SIMPLIFIED MECHANIZATIONS 


The purpose of this section of the paper is to consider 
two simplified versions of the two-condition terminal 
control system developed in Section III. The first sim- 
plification is in a form suitable for implementing a prac- 
tical system. The second simplification is in a form 
which makes possible a stability analysis, thus giving 
additional insight into the type of control provided by 
the terminal controller. 

The first simplification is developed in Appendix III 
and is illustrated in Fig. 5. This system has three feed- 
back paths: altitude, altitude rate, and altitude rate 
error. The altitude rate and altitude rate error feedback 
signals are passed through weighting functions which 
can be considered as time variable gains. The altitude 
signal passes through a fixed gain. In addition, an alti- 
tude rate bias which represents the desired value of alti- 
tude rate at touchdown is passed through a weighting 
function and also biases the altitude rate feedback sig- 
nal. The terminal control landing system in Fig. 5 can 
be readily implemented with two servo assemblies and 
three signal amplifiers. The three signal amplifiers are 
used for the necessary mixing and isolating functions 
indicated in Fig. 5. One of the two servo assemblies is 
used for the integration function indicated in Fig. 5. 
The second servo assembly is used for mechanizing the 
weighting functions. 
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Fig. 5—Simplified terminal control landing system. 


The weighting function servo assembly contains three 
function potentiometers. When the shaft is driven at a 
constant speed, the independent variable corresponding 
to the shaft position is 7—t. This servo provides the 
“clock” function for the terminal controller. 

Only two weighting functions, Hy, and Hj, are non- 
linear functions of (7—t#), requiring special shaping. 
The function #(T)a [—K(T—1)| is formed by a linear 
potentiometer on the shaft, having a constant input. 
The input /. to the Hi, potentiometer is taken directly 
from the output of a summing amplifier. Biased altitude 
rate (h—h(T)a) is derived from an altitude rate sensing 
instrument (preferably a radar altimeter-monitored 
inertial sensor®), and the altitude / is taken from a radar 
altimeter. These three potentiometer outputs are 
summed, together with [—K]h into the input of the 
h, integrator, which may be an electronic integrator or 
an electro-mechanical servo with rate feedback. The 
difference between this altitude rate command and / 
(derived as above) is then available at a summing am- 
plifier output to be used as an input command to the 
autopilot inner pitch rate loop. 

It is thus possible to provide a simple landing system 
mechanization and yet maintain the inherent advan- 
tages of the terminal control concept. 

A second simplification developed in Appendix IV 
yields a block diagram of the terminal controller as il- 
lustrated in Fig. 6. This configuration results when the 
various feedback signals in Fig. 4 are combined using 
the numerical values existing at some particular fixed 
time. With this simplification, it will be noted that the 
terminal controller can be viewed as a conventional con- 


5 E. R. Buxton and E. W. Velander, “Landing System for Com- 
mercial Aircraft,” presented to the IATA, Montreal, Quebec, Can.; 
April 6, 1959. 
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Note: Ki, Ks, a, and } are functions of T—¢ 


Fig. 6—Terminal controller as feedback system with time-varying 
gains and time constants. 


TABLE I 
h, TRANSFER FUNCTIONS AT SELECTED INTERVALS* 
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T —t = 16 sec 
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T —t = 12 sec 
19863-4055) Osea 
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T —t = 4sec 
.  1.838(s + 1.09) aetaate 
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Gee peeee 
T—t=1 sec 
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* The coefficients of the following /, transfer functions were taken 
from the numerical values of the weighting functions of Fig. 4. Curves 
1 through 4 were plotted for these gain values as functions of time. 
These expressions are the numerical values for (45). 


trol system with various “transfer functions” in the feed- 
forward and feedback loop. The quotations on transfer 
function are used to remind the reader that the transfer 
functions obtained are valid only at a specific time and 
only in a restricted sense. The gains and time constants 
of the terminal control “transfer functions” are func- 
tions of time. A numerical tabulation of these param- 
eters presented in Table I of Appendix IV shows that 
these parameters vary slowly with time. This slow vari- 
ation leads one to consider a stability analysis in which 
time is “frozen,” or the parameters a, b, Ki and Ky, are 
considered constant. : 

Such a stability analysis is illustrated by the root 
locus in Fig. 7. The root locus indicates that the damp- 
ing of the altitude roots is reduced somewhat by the 
action of the terminal controller. However, the dom- 
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Fig. 7—Stability of terminal controller at fixed time. 


inant response of the system will result from the real 
root located at —8, giving rise to a decaying exponential 
type response. The time constant of this exponential is 
growing smaller as the terminal time is approached. 

It should be remembered that the point stability anal- 
ysis suggested in this example is quite analogous to the 
point stability analyses commonly conducted on a mis- 
sile booster for which the differential equations describ- 
ing the booster motion have time-varying coefficients. 
In a like manner as in this analysis of the terminal con- 
troller, the coefficients of the booster differential equa- 
tions are assumed fixed at the point at which the stability 
is considered. 


V. TrEst RESULTS 


The basic concept of the terminal control landing sys- 
tems discussed in this paper has been verified by exten- 
sive analog computer simulations and two flight test 
programs. The first flight test program involved a 
TF-100F and was conducted during the winter of 1959 
and 1960. The TF-100F configuration was similar to 
that shown in Fig. 4. This program resulted in a number 
of successful automatic landing flares and tested the 
concept of manual instrument flares utilizing the pilot to 
null the pitch bar of the attitude displays indicator dur- 
ing the flare maneuver. 

A simplified version of the autoflare system similar to 
that shown in Fig. 5 was successfully flight-tested in a 
TF-102A during the summer and early fall of 1960. A 
number of successful automatic landings were accom- 
plished in this program at several different airports in 
the Los Angeles area. 

These landings were accomplished with the pilot un- 
able to see outside the cockpit. The terminal control 
landings were considered to be satisfactory from a 


pilot’s and passenger’s point of view. The ‘touchdown | 


sinking rate was 2 feet/sec or less in most cases. The air- 
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craft touched down within 50 feet longitudinally of the 
same point on the runway under the test conditions. 

Two very important characteristics of the terminal 
control landing system have been observed in the analog 
and flight test results: 1) the terminal control concept 
used makes the landing performance singularly insensi- 
tive to off-nominal initial conditions, gain variations and 
gust disturbances, and 2) the system is considerably 
easier to land in the manual instrument mode than the 
previous landing systems which have been investigated, 
such as the exponential flare type of landing system and 
the programmed path type landing flare computer. The 
superiority of the terminal control system is particularly 
pronounced in the presence. of gust disturbances. This 
characteristic allows a qualified instrument pilot to 
make consistently good landings even under adverse 
conditions. 

Fig. 8 illustrates the effect of off-nominal initial con- 
ditions on the landing flare trajectory. The nominal 
sinking rate for the TF-102A at flare trigger is 15feet/sec 
(900 feet per minute). Fig. 8(a) shows the altitude and 
altitude rate traces as a function of time for an analog 
computer run. Fig. 8(b) and (c) show the effects of plus 
and minus 50 per cent variation from the nominal sink- 
ing rate. It will be noted that very little change in the 
flare path shape occurs. The desired terminal conditions 
of 2 feet/sec altitude are met for this large variation in 
initial sinking rate. The time at which touchdown occurs 
varies by approximately 14 seconds from the nominal 
value of 13 seconds. The variation represents a range 
variation of approximately 350 feet. The initial altitude 
rate variations are considerably greater than is to be 
expected under normal circumstances. 

Fig. 9 shows a comparison of a typical analog com- 
puter simulation with flight test results of the terminal 
control landing system. Even though the initial sinking 
rates of the two traces were not exactly the same, the 
shape of the flares compared very closely. In general a 
close agreement was found between the flight test re- 
sults and the analog computer simulation of the autoflare 
system. 

According to the theory developed in Appendix II, 
non-nominal aircraft velocity histories affect the flare 
only inasmuch as the aircraft altitude rate response is 
changed. As this response deviation is generally slight, 
no appreciable flare differences are anticipated resulting 
from these velocity dispersions. 

By way of confirmation of this conclusion, analog 
computer simulations have indicated that longitudinal 
velocity variations prior to landing flare initiation have 
no significant effect on the landing flare trajectory. 


VI. CONCLUSIONS AND SUMMARY 


In this paper, a procedure is described which can be 
used to synthesize a terminal controller when the differ- 
ential equations of a system are known. This technique 
is illustrated for the case of a landing aircraft with an 
altitude rate autopilot. 
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Fig. 8—Altititude and altitude rate trajectories for several values 
of initial altitude rate. 
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Fig. 9—Comparison of analog computer simulation and flight test 


results of terminal control landing system. 


The procedure gives rise to a controller which can be 
simply implemented using standard servo hardware. 
The net result of the synthesis procedure is a feedback 
controller with gains which are varied as a function of 
time in a desirable manner. 

It is suggested that the terminal control technique 
could be applied to many present-day and future con- 
trol problems in which the system differential equations 
can be written. There are a number of space applications 
such as a soft lunar landing and orbital rendezvous 
problems for which terminal controllers may find useful 
applications. 


APPENDIX | 


TERMINAL CONTROLLER EQUATIONS FOR A 
GENERALIZED SYSTEM 


As pointed out in the introduction, the value of any 


system state variables at any specified time in the future - 


can be determined from a knowledge of the differential 

equations which describe the motion of the system and 

the present values of all the system state variables. 
This simple statement is the essence of the prediction 
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equations, which are nothing more than time solutions 
of differential equations, based upon initial conditions 
taken always at the present. The time solution of these 
differential equations may be obtained in any manner 
desired. In the following discussion, solutions for a gen- 
eralized system are obtained by the Laplace transform 
method, which is well suited for the solution of simul- 
taneous sets of system differential equations with known 
initial conditions. Consider a system described by the 
two differential equations 


ana™ a On 16Y + Sl atte + ox + bny™ 


brea a es Oey a a oe 
igi teen a ree vects ra tcp Lee 
b gm aay oe a oy nk Ee 


where x” denotes the uth derivative with respect to 
time d"x/dt". Taking the Laplace transform of these 
equations yields 


(ans” + dns"! + + + + + a.) X(s) 
+ (bms™ + bm—is”-? +--+ + bo) Y(s) = FG) 
fb (GnS?* gas ai) 08) 
SF AGS 2 AP Dani ime et ag) ae 
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b. (Bigst=2 Eo Bye pathy ie ta) yg) eee 
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where x”(o) denotes d"x/dt"| :<0, i.e., the nth time deriva- 
tive of x evaluated at t=0. These equations (7) and (8) 
can then be solved as algebraic equations for X(s) and 
Y(s), from which desired time solutions can be written 
by taking the inverse Laplace transform. For instance, 


a(t) = 2) (0) Hy_i(t) + 2?) (0) Hp_o(t) + +>: 
+ (0) H(t) + 9") (0)Fm—i(t) 
fy 0) Taal =P oua@) 


+ f Font -1-aar (9) 
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where H, J, and J are the so-called weighting functions 
which are (in this case) found as follows: 


NEO! 
ia, = at An-1 = a eee 
Qa Lda) = e ( = ) (10) 


where A(s) is the system characteristic determinant and 
A*m-1)(s) is the system determinant with the x(s) 
column replaced by the x‘"—) (0) coefficients. 


Similarly 
Tce 
Ima) = a |) (11) 
and 
ie p-1( 220) (18) 
A(s) 


Of course, a similar expression can be obtained for y(t). 

Eq. (10) is the desired expression for x as a function 
of time and the initial conditions of the various system 
parameters. At this point it is convenient to generalize 
the extrapolation relationship (9) to express the pre- 
dicted value of a desired parameter at a future time T 
by observation of the current values (initial conditions) 
of the system parameters at any prior time ¢. This can 
be accomplished merely by a shift of origin of (9) anda 
redesignation of the time variable in such a way that the 
resulting expression is meaningful in terms of a fixed 
time reference. If the time at which the value of x is 
desired is J and the time at which the various parameter 
values (initial conditions) are known is ¢, then the pe- 
riod of extrapolation becomes 7 =¢ and the prediction 
equation becomes 


a(T) = x) (t)Hn-a(T — ¢) 
+ 2°) Hy (T — 1) + +++ + 2()HAT — #) 
+ y"D()Ina(T — 2) 
+ yO )()Imn—(T —) + +--+ ¥QIAT — 1) 


+f rent —i—A)dr. (19) 


t 

It is then seen that in a linear system the value of any 
parameter x existing at future time T may be predicted 
based upon values of the system quantities x and y and 
their derivatives (up to an order one less than the high- 
est-order derivative of the particular quantity appear- 
ing in the differential equations) at any time ¢ prior to 7. 
In addition, a knowledge of the future behavior of the 
forcing function F must be had. The convolution inte- 
gral is avoided if the transform of F can be taken 
[(7) and (8) ]. In terminal control systems F is usually 
taken to be zero, a constant, or a ramp which simplifies 
the prediction equation. 
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It is seen that the weighting functions such as 
Hy, «3(T—t) and Jm1(T—t) are the time solution con- 
tributions to « produced by unit values at time ¢ of the 
associated parameters, e.g., H,1(7—#) is the amount 
by which x changes between t and T due to a unit value 
of x” at time ¢. Because of linearity, the total predic- 
tion x(7’) is made up of the sum of all such prediction 
components. As outlined above, these weighting func- 
tions can be calculated mathematically, but they can 
also be determined directly on an analog computer. The 
definition of these weighting functions suggests that, 
once the system equations are set up on the computer, a 
given weighting function, say H,_;(7—t) may be deter- 
mined simply by starting the problem with all the 
parameters (the various quantities and their p—1 de- 
rivatives, where ? is the highest-order derivative of that 
variable appearing in the original equations) set to zero 
except x‘"~)), which is set to unity.® The weighting func- 
tion is then the resulting x output. For similar physical 
reasons, it is apparent that the problem solution can de- 
pend only upon F(t) and the initial values of all the 
integrators in the problem. Thus the analog computer 
can be used to determine what weighting functions are 
required and their actual shapes. Since most complex 
problems will be analyzed on the computer to evaluate 
system performance, if nothing more, it is most desirable 
from the standpoints of time and accuracy to obtain also 
the required weighting functions in this manner. 


APPENDIX II 


DEVELOPMENT OF LANDING AIRCRAFT 
PREDICTION EQUATIONS 


In this appendix the altitude and altitude rate pre- 
diction equations for the simplified model of the landing 
aircraft (Fig. 1) are developed. 

The third-order differential equation in Fig. 1 may be 
solved by taking the Laplace transform, including the 
initial conditions in the manner of Appendix I: 


[s*H(s) — s*h(o) — sh(o) — h(o)] 

+ 2en[s*H(s) — sh(o) — h(o)] 

+ wn?[sH(s) — h(o)] = wn?H.(s), (20) 
where 


s=complex frequency variable 
H(s) =Laplace transform of h(t) 
h(o) =initial condition of altitude 
h(o) =initial condition of altitude rate 
h(o) =initial condition of altitude acceleration 
H,(s) =Laplace transform of h(t). 


6 Since these parameters are invariably represented by integrator 
outputs, this requires merely that all the integrators (except one) 
be set to begin the problem with no initial conditions applied. 
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This equation may be solved for H(s) with the follow- 
ing result: 


(3) = ko) —+ Ho)| So baahen 


$(s? + 2Fan + wn”) 
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oe 
s(s? + 2¢eons + =: 

In taking the inverse Laplace transform of (21) to ob- 
tain h(t), no difficulty is encountered except with the 
last term. In order to complete the inverse transforma- 
tion, it is necessary to know the form of H,(s). Justifi- 
cation for assumption of a simple form, namely a step 
for h,(t), is provided in Appendix I. A more desirable 
form of h, for a landing system is a ramp input, which 
corresponds to a step input into an integrator pre- 
ceding the h(t) point of Fig. 1. A ramp input ensures a 
smoother control than the step input. For the ramp 
input 


h(t) = he(o) + he(o)t. 


The Laplace transform is 


i.(9) = heo)| —| + ito)| =]. 


Substituting (23) into (21) yields 
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Se(s" sm Fans Sr al 
Taking the inverse transform of (24), the following 
time equation is obtained: 


h(t) = h(o) Fat) + h(o) Fit) + h(o)Fi(t) + he(o) Fi,(0) 


aa h.(0) Fi, (2) (25) 


where the F’s are the altitude weighting functions de- 
fined in Fig. 10. Fig. 10 also shows sketches of the shape 
of the weighting functions vs time. 

Eq. (25) represents the value of altitude / that exists 
at the present time (¢) as a consequence of certain con- 
ditions h(o), h(o), he(o), he(o) having existed at some 
previous time f seconds ago. An equation for h(t) can be 
derived in a similar manner, or it can be obtained by 
directly differentiating (25), keeping in mind that only 
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the F’s are time-varying. In either case an equation 
for h(t) results as follows: 


h(t) = h(o)Gi(t) + h(o)Gi(t) + h.Gi(t) + he(0)Gi,,(2) 


where the G’s are the time derivatives of the cor- 
responding F’s and represent another set of weighting 
functions which are defined together with the weighting 
function shapes in Fig. 11. 

A substitution made at this point will result in a 
simplification of two of the shapes which must be mech- 
anized in order to form the prediction equations. 

Notice that /., h. and h are related as follows (Fig. 1): 


(27) 


(26) 


he=h+th. 


If this equation is substituted into (25) and (26) to 
eliminate /,, and terms are recollected, the following 
equations result: 


h(t) = h(o)Fr(t) + h(o) [Fi(t) + Fi] + h(o) Fi) 
+ h.(0) Fi) + he(o) Fi, (2) (28) 

and 

h(t) = h(o) (Git) + Ga)] + h(o)GK, + he(0)Gi,() 
+ he(0)Gi, (0). 


Now the weighting functions that are collected to- 
gether may be examined. 
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Therefore, 
Fi(t) + Fi, = [2]. (31) 


(The brackets are used to avoid confusion with the func- 
tional notation.) In similar manner, 
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Fig. 10—Altitude weighting functions. 
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Substituting (32) and (34) into (29) and (30) and here- 
after defining Fi,= Fi, and Gi;,=Gij,, the following equa- 
tions result: 
h(t) = h(o) + h(o)|t] + h(o) Fit) + he(o) Fi, 
+ he(0) Fi, (2) (34) 
h(t) = h(o) + h(o)Gi(t) + he(o)Gi,() + he(0)Gi,(t). (35) 


Eqs. (34) and (35) can be generalized by considering 
the present conditions the initial conditions [argu- 
ment (t) rather than (0)], thus requiring an argument 
(T'—t) for the variable terms when considering a gen- 
eral time 7. This shift of time reference yields 


A(T) = h(t) + hw) [T — t] + APT — 


Thre (DT = 1) hk (T — 1) * (36) 
h(T) = h(t) + hOG(T — 1) + h.)Gi(T — 1) 
pee) Gad st) (37) 


Eqs. (36) and (37), which are the same as (20) and 
(21), are the so-called prediction equations, which extrap- 
olate, by means of differential equation solution, the 
existing conditions to the conditions at future time 7. 
It is to be recalled that this extrapolation is predicated on 
the assumption of the constancy of the input rate h, 
from present time ¢ until terminal time 7. 
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This technique of combination is valid for finite values 
of gain K and sufficiently high limits on h,, and hee At 
has been determined from simulation studies that the 
effect of # is usually small since it has relatively small 
values for the weighting functions and can be neglected. 
The last term of Eq. (38), the desired terminal altitude, is 
zero. Considering these points, (38) may be arranged as 


s Gi, 
he = he| — 
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Ch le Kd) eC (39) 
ee 
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+ h(T)a| = KT alae (40) 


thereby defining new composite weighting functions 
Ay,(7—t) and Hi(T—t). The landing system mecha- 
nization, thus simplified, is that shown in Fig. 5. 

It may be noted that all F’s and G’s appearing in (38) 
approach zero as (7’—t)—0. Accordingly the (t—h(T)a) 
term becomes important and quite large. It is therefore 
reasonable to cause other weighting functions to go to 


_ zero and to limit Hj. This effectively establishes a con- 


APPENDIX III 


SIMPLIFICATION OF TERMINAL CONTROLLER 
MECHANIZATION 


In this appendix the simplification of the terminal 
controller mechanization suitable for implementation 
(described in Section IV) is developed. 

This simplification begins with the two-condition 
terminal controller illustrated in Fig. 4 and combines 
feedback paths by algebraic manipulation of the weight- 
ing functions. 

The expression for altitude acceleration command h, 
can be written as 


* : Gi, 
he= i] - =a eee Lit) i= KP, | 5 
Gi;, 


he 
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— h[K] + h(T)a[K]. (38) 


trol system designed to hold h=h(T)a near the ground 
as time runs out, which corresponds to the control phil- 
osophy expected at this point of the flare. 


APPENDIX IV 


TERMINAL CONTROLLER AS SERVO WITH 
TIME-VARYING PARAMETERS 


This appendix provides a simplification which is ob- 
tained by combining the feedback paths of the terminal 
controller in Fig. 4. This approach obtains an equivalent 
transfer function for the terminal controller assuming 
that time is fixed or “frozen.” The following equations 
can be written from inspection of Fig. 4: 
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Combining (41) and (42) to eliminate /,, the following is 
obtained: 
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Collecting terms in /,(s) on the left, obtain 
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Eq. (44) may be manipulated easily into the form 


Ki(s + b) 
hes) = + Ks) =~ hl) 
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Using (45) as the representation for the terminal con- 
troller, a simplified block diagram of the landing system 
may be drawn as illustrated in Fig. 6. 

In Table I, a tabulation of the expression for /,(s) at 
seven different values of 7’—t from 20 to 1 second is pre- 
sented for the terminal controller representation of Fig. 
6. This tabulation should give the reader a feeling for 
the magnitude of a, b, K; and Ky», and also how these 
parameters vary as a function of time. It will be noted 
from the tabulation that the parameters vary relatively 
slowly with time. 
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A Parameter-Perturbation Adaptive Control System” 


R. J. McGRATHf}, MEMBER, IRE, V. RAJARAMANT, stuDENT MEMBER, IRE, AND 
V. C. RIDEOUTI, FELLow, IRE 


Summary—Theoretical and simulation studies of a parameter- 
perturbation self-adaptive system are discussed. A number of system 
block diagrams are included, showing diverse applications of param- 
eter-perturbation adaptive techniques. A particular study has been 
made using error signals based on an ideal model, and the concept of 
high-frequency perturbation of the model has been introduced. 

A linearized mathematical model of the adaptive loop for the sys- 
tem-adaptive scheme has been obtained using time-varying system 
analysis. Experimental verification of the mathematical model has 
been obtained with an analog computer. It is shown that increased 
speed of adaptive loop response is possible with high-frequency per- 
turbation of model parameters. 

Simulation studies have also shown the feasibility of adaptive 
control with random system input, and random parameter disturb- 
ances. 


I. INTRODUCTION 


ye the rapidly increasing amount of atten- 


tion now being given to self-adaptive systems, 
little attention has been paid to one of the forms 
of such systems, that is, the parameter-perturbation 
scheme. This method, first mentioned by Draper and 
Li,! was dealt with at some length in a recent paper by 
McGrath and Rideout.? Other investigators** have also 
given this method some recent attention, particularly 
in the field of process control.® 
The parameter-perturbation self-adaptive scheme is 
only one of a number of effective feedback schemes. It is 
a general one in that it can permit an optimum adjust- 
ment of one or more parameters (according to a chosen 
performance measure) in spite of changes in any param- 
eters or in input statistics. Good progress has been made 
toward maximization of its speed of response and elimi- 
nation of perturbation effects from system output. 


II. BLrock DIAGRAMS oF ADAPTIVE SYSTEMS 


Fig. 1(a) shows the basic parameter-perturbation 
adaptive system.” The error signal, in this case a “model 
error,” is used to form an instantaneous error measure, 


* Received by the PGAC, December 15, 1960; revised manuscript 
received, March 15, 1961. — 

7 Aerospace Corp., Los Angeles, Calif. Formerly with the Uni- 
versity of Wisconsin, Madison, Wis. 
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2 R. J. McGrath and V. C. Rideout, “A simulator study of a two- 
parameter adaptive system,” [RE TRANS. oN AUTOMATIC CONTROL, 
vol. AC-6, pp. 35-42; February, 1961. 

3G. Vasu, “Experiments with optimalizing controls applied to 
rapid control of engine pressure with high amplitude noise signal,” 
Trans. ASME, vol. 79, pp. 481-488; April, 1957. 

4P. Eykhoff and O. J. M. Smith, “Optimalizing control with 
process dynamics identification,” to be published in IRE Trans. on 
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5G. E. P. Box, “Some general considerations in process opti- 
matization,” Trans. ASME, JBE, vol.-82, pp. 113-119; March, 1960. 
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(b) 


Fig. 1—Basic configuration of parameter-perturbation 
adaptive system. 


which, here, is the error squared. This measure contains 
a component of the frequency w at which a controllable 
parameter a is being perturbed. The amplitude and 
phase of this component give the magnitude and sign 
of a signal which can be recovered by multiplication and 
integration, as shown. This is fed back negatively to 
reduce the short time average of e?(t). 

There may be a number of adaptive loops, each with 
a different oscillator frequency, and each controlling a 
different parameter. If the loops have the same gain, 
simultaneous control along a path of steepest descent 
will tend to result.2 Also, additional elements in the 
loops may be desirable. These include a filter after the 
squarer, and a limiter after the multiplier. 

As pointed out in a previous paper,” this system can 
be both signal-adaptive and system-adaptive. However, 
if the model is one to which the system may become 
identical under the influence of its adaptive loops, then 
it can only be system- (or parameter-) adaptive, because 
the error disappears when identity is reached no matter 
what the signal may be. 

Fig. 1(b) is a simplified representation of the basic 
system shown in the first diagram, with only one adap- 
tive loop shown, as before. 

One difficulty encountered in the parameter-pertur- 
bation system is that the perturbation appears in the 
output. This may be avoided where a model is used 
which is of the same form as the system, or nearly so, by 
perturbing the parameter in the model corresponding to 
the parameter to be controlled in the system, as shown 
in Fig. 2. This has the further advantage, with high- 
frequency perturbation, of phase-shift problems being 
reduced. However, this scheme is limited to the case 
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Fig. 2—A system-adaptive parameter-perturbation system. 


where the disturbed parameter and the controlled 
parameter are essentially the same. 

It is possible to use different error measures (e?, e| f 
| ", etc.) for the adaptive loops where more than one 
parameter is to ‘be controlled. Also, different models 
may be used in forming the error. Fig. 3 shows one 
example of the use of multiple models. Here, the upper 
model and the adaptive loop are as in Fig. 2, with per- 
turbation of this model, which must therefore be nearly 
identical to the system. The other adaptive loop uses 
perturbation of the system. Its model might be different 
from that of the system, so that changes in input statis- 
tics are emphasized in €&. Thus, in effect, the first loop 
corrects a@ to compensate for system changes a, and 
the second loop corrects 6 to compensate for input 
changes. Note that correction in 6 must be applied to 
model 1. 

Another configuration which is both system-adaptive 
and signal-adaptive is shown in Fig. 4. Here, model 1 is 
optimized for changes in input statistics by adaptive 
loop 2 which operates on the error €, between model 1, 
which is of the same form as the system, and model 2, 
which is of a different form such as to emphasize changes 
in input statistics. Adaptive loop 1 causes the system 
parameter a to follow the model parameter a,, which has 
been optimized for input statistics, and at the same time 
corrects for disturbances da. 

The parameter-perturbation scheme may be used to 
make a plant “follower” as shown in Fig. 5. Here, a plant 
follower or the “learner” discussed by Margolis and 
Leondes® is caused by means of a parameter-perturba- 
tion adaptive loop (or loops) to follow changes in a 
plant which cannot otherwise be known and followed. 
Here the plant follower is a model, the parameters of 
which are forced to follow those of the plant according 
to the schemes discussed above. The information from 
the adaptive loops is then used to compute, according 
to predetermined formulas, desired changes in the con- 
troller parameters. 

It has been mentioned that feed-forward should be 
used where possible.? Thus, information obtained by 


6 M. Margolis and C. J. Leondes, “A parameter tracking servo 
for adaptive control systems,” 1959 IRE WESCON ConvENTION 
RECORD, pt. 4, pp. 104-115. ; : 7 : 

7 J. Balchen, “The Use of Automatic Experimentation Combined 
_ with Mathematical Models in Optimalizing Control of Continuous 
Processes,” presented at the Fifth Internatl. Instruments and Meas- 
urements Conf., Stockholm, Sweden; September, 1960. 
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Fig. 4—A system and signal-adaptive scheme utilizing 
perturbation of model parameter. 
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Fig. 5—Mechanization of Margolis-Leondes scheme 
using parameter perturbation. 


processing the signal (by autocorrelation estimation,® 
for example), and by use of the outputs of various 
sensors which are related to system parameters, may be 
used as shown in Fig. 6 to control some parameters a 
and 6 of a system in a near-optimum fashion. An adap- 
tive loop (or loops) may be added as also shown in Fig. 
6 to “trim up” a parameter (or parameters), whether or 
not they are also to be controlled by feed-forward means. 

The complexity of a parameter-perturbation loop is 
apt to be mentally perturbing. The cireuit of Fig. 7 
shows how such loops might be simplified. Here, the per- 
formance measure is square law (if the crystal rectifiers 
are square law), and filtering is accomplished in the 


8 G. W. Anderson, R. N. Buland and G. R. Cooper, “The aeronu- 
tronic self-optimizing control system,” Proc. WADC Self-Adaptive 
Flight Controls Symp., Wright Air Dev. Ctr., Dayton, Ohio, Tech. 
Rept. 59-49; March, 1959. , 
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Fig. 6—An adaptive scheme using feed-forward 
and feedback control. 


Fig. 7—A simple mechanization of the adaptive-loop components 
of parameter-perturbation schemes. 


control phase of a two-phase motor by adding a shunt 
capacitor. The motor has its excitation phase fed by an 
oscillator (which may require but a single transistor). 
The motor acts as multiplier and integrator, the output 
being obtained from a shaft-driven potentiometer, as 
shown. 

The detailed block diagram of the system discussed in 
the simulation studies is shown in Fig. 8. Suppose the 
system damping varies unpredictably over a large range 
because of changes in a. Also, let us assume that the 
controller gain b can be adjusted to compensate for this. 
The purpose of the adaptive loop is to identify varia- 
tions in the parameter a, and suitably adjust b, so that 
ideally a+0=2¢w,, the fixed model damping. (Here, w, 
is assumed invariant.) 

In order to do this, ¢, in the model, is sinusoidally 
perturbed at a high frequency v. Since the model and 
system are assumed identical, the only terms appearing 
in the error are due to the disturbances of the system 
(away from ideal), and the perturbation of the model. 
Assume a sinusoidal input of frequency 7 as the input 
to the system. (This particular input is considered for 
simplicity of explanation.) Let the power spectrum of 
disturbance be rectangular of width 2 \ centered on zero 
frequency (assume y>>7>>A). Fig. 9 shows the spectra 
of the signals at points (a), (b), (c) and (d) of Fig. 8 
(the adaptive loop is assumed open). It is clear from 
Fig. 9(d) that at the point (d) in Fig. 8, the disturb- 
ance spectrum has been recovered, so that the informa- 
tion to control 6 is available. 

It is apparent that the disturbance is identified by the 
combined effects of the input, perturbation and the 
adaptive loop components. Use of a cosine input has 
simplified the explanation. However, the system is capa- 
ble of working with normal system inputs, except that 
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Fig. 8—Adaptive system used in simulation studies (7>1). 
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Fig. 9—Spectra of signals at points (a), (b), (c) and (d) of the system 
of Fig. 8 with adaptive loop open. Input to the system is assumed 
sinusoidal of frequency 7. Disturbance spectrum assumed low- 
pass of width 2 \. Dotted line in (c) indicates the low-pass filter 
characteristics, and (d) shows the spectrum detected by adaptive 
loop. Higher-frequency components are not shown in (b) and (c). 


the filtering problem is more stringent, and consequently 
the adjustment is slower. In fact, in the simulation, the 
input was a random process and the system was dis- 
turbed by an independent narrow-band low-frequency 
noise source. Under these realistic conditions, the adap- 
tive scheme worked quite well. 

It is of interest to note (Fig. 9) that the use of high-: 
frequency perturbation has led to good filtering possi- 
bilities and consequently to rapid identification of dis- 
turbances. Thus, the speed of response of the adaptive 
loop is improved considerably by using a high-frequency 
perturbation of the model. 
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Ill. A LIngEARIZED MATHEMATICAL MopEL 
OF THE ADAPTIVE Loop 


Before deriving the linear model, a short review of 
time-varying systems is in order. In the time domain, a 
system output may be obtained from its input x(¢), by 
using 


y(t) -{ h(t, r)x(r)dr, (1) 


where h(t, 7) is the impulse response of the system. 
For time-invariant systems, this reduces to 


t 
y(t) -| h(t —7)x(r)dr: (2) 
If the input is e’*‘, then 
y(t) = H(jw)e', (3) 


where H(jw) is the Fourier transform of h(t) and is called 
the transfer function. 
If the system is time-varying with an input e’*‘, then 


y(t) = eet f h(t, t = t)e—iT dr 
0 


= el*!H (jw; t) (4) 


where H(jw; t) is defined as the time-varying system 


function. 
Consider the differential equation of a time-varying 
first-order system, 


dy 
ee + a(t)y() = x(t). (5) 
If x(t) =e’*', then using (4) we have 
d . * . 
es [ei (jw; t) | + a(t) H (ju; tei = et! 
t 


or 


d . 

=, eGo | + HGes dla + jo] = 1. (6) 
The solution of (6) gives us the time-varying system 

function and allows us to solve for the response to other 

types of inputs; for, if we have an input ei(t) with 

Fourier transform E,(jw), then the output is given by 


1 a : 
eo(£) = —{ (jw; t) Ey (jw)ei'dw. (7) 
Darel) pe 
Eq. (7) can often be evaluated using contour integra- 
tion. This frequency-domain approach to time-varying 


systems is due to Zadeh.’ 


Ui Ba Tate “Frequency analysis of variable networks,” Proc. 
IRE, vol. 38, pp. 291-299; March, 1950. 
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Consider the simple first-order feedback system with 
the transfer characteristic 


Ca(jo) = cat ne om ) (8) 


and a model described by 1/(jw+M) (Fig. 10). Ideally, 
(b+a) must equal M, which is the reference value. In 
the actual system, the parameter b changes unpredicta- 
bly. We assume that b cannot be directly measured, nor 
can its variations be quickly determined from other 
data. The adaptive loop is used to control a so that 
b+-a approximately equals M at all times. The param- 
eter disturbance away from the normal is detected with 
the aid of sinusoidal perturbation of M in the model. 


PHASE SHIFTER 


| 
p+M (ItmCosvt) 


Fig. 10—Adaptive system used in the analysis. Here, v is the fre- 
quency of perturbation of parameter 1; } is the frequency of dis- 
turbance of parameter }; a is the normal gain of controller, and 
p is the operator d/dt. 


Consider the differential equation of the sinusoidally 
perturbed model: 


dc 


i + M(1 + mcosvt)¢m = r(t). (9) 
t 
Here, m is the fractional change in M, and vis the per- 
turbation frequency. Other quantities are defined in 
Fig. 10. In order to find the time-varying system func- 
tion corresponding to the above differential equation, 
we use the technique developed in deriving (6) and ob- 
tain 
d . . . 

Fe Cn(jo; ) + (M + jo) Cm(jo; #) 

= 1— MmcosviCn(jw;t), (10) 


where C,,(jw; t) is the time-varying system function of 
the model. The perturbation technique (proposed by 
Zadeh!®) for solving this equation consists of first neglect- 
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ing the term with the time-varying coefficient and ob- 


taining a solution Cmo(jw; t). Successive solutions are 
obtained from 


d 
a Crmn(jo; t) + (M + ja) Cmn( Jo} t) 
dt 


= — Mm cos viCmm—1)(jw; 1). (11) 
The complete solution is then 
Cul jo;#) = 2, Cmn(jw;t). (12) 


n=0 


This summation develops into a Fourier series with 
fundamental frequency v, with the coefficients as a 
power series in —mM/(M-+jw-+jv). Since 


mM 


eee <m <1, 
M = - 7a. yy. 


in the approximate analysis we retain only the first two 
terms. Thus, we have 


Cin(Jw; t) 


1 4 [= 1 | 
~ M + jo Pe Me ja 


eave 


be | 9) 
Majo — 4v 


| ert 
M 4- ja. Fv 
Our aim is to obtain a linear equivalent of the open 
adaptive loop which detects changes in b. Therefore, we 
assume that the variation of b is sinusoidal and is given 
by b(1+ cos Nt), where pis the per unit variation of b 
from normal, and ) the frequency of disturbance. The 
differential equation of the sinusoidally-disturbed sys- 
tem is 


da 


dt 


+ d(1 + pcosAt)ca + ac, = r(t). (14) 


We note the similarity of (9) and (14), and following the 
same reasoning, obtain for the approximate system func- 
tion of the disturbed system: 


Ca(jo3 2) eles |" | 
BAO) WE) geo ree MO eae eae 
he Weenee A apa 
elrt e int 
| ea woe Mes= Gor 4N 

The error is formed by taking the difference between the 
model and the system outputs. Thus, using (13) and (15), 
we obtain for the transform of error 


E(ja; 2) 


AS eee reas 
1 M4 Go 2 M+jotjv M+jo—jp 


eit ent 


=D 
S Coale; ia sae ear yeeros el, (16) 
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We now assume that the input to the model-system 
combination is a fixed amplitude sinusoid given by 


r(t) = R cos nt. 


(17) 


With this input, the “time-domain” expression of the 
error [obtained by inverse transforming of (16) | is given 
by 


R 
e(t) = 
ph ONS espe hal 
(— Mm) ae 
diem ran eens 
2 n 4 a 
(— Mm) — 
+ gay Oa att bod 
(— bp) —-~ 
ioe les Ga} Galen eae 
(— bp) —-< 
an e+ G@ — neji 8 = X16: + 60], 
where 
di = ee go: = et $3 = tan“! aes : 
X = 
dy = tant, and @; = tan"! me (18) 


If we now assume that y>>7>>A, (18) is greatly simpli- 
fed. This assumption implies that: 1) we perturb the 
model parameter at a high frequency; 2) the disturb- 
ance of the system parameter is much slower than 
perturbation frequency; 3) the input frequency is. be- 
tween these two frequencies; and 4) the disturbance 
frequency is much smaller than the cutoff frequency of 
the system. We are solely interested in the “detected” 
signal at the output of the low-pass filter (Fig. 10). Thus, 
after squaring e(¢), we retain only the terms useful for 
this purpose and they reduce to a single term given by 


1 R°bM mp cos $1 
2 (M2 + 7)3/2(M2 + p2)1/2 
-[cos (vt — os) cos d¢], 


where ¢;=tan“!7/M and ¢:=tan-! p/M. This signal is 
multiplied by cos(vt—y). It is then filtered by a narrow- 
band low-pass filter intended to attenuate frequencies 
much greater than \. If we suppose that the low-pass 
filter has a transfer function (A/(1+ p7), we may repre- 
sent the scheme used to detect the parameter disturb- 
ance bp cos Mt by the linear model shown in Fig. 11. If 
the disturbance, instead of being a sinusoid, is a low- 
frequency narrow-band signal Ab(t), the same model is a 
good approximation of the “detection scheme” used in 
the adaptive servo. 

In the adaptive servo, the detected parameter dis- 
turbance is fed back negatively tothecontrollable param- 
eter. This provides a closed-loop control of the parame- 
ter. Using the linear model of Fig. 11, we may represent. 


ces ful (t) = 


(19) 
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Fig. 11—Open-loop linear equivalent representing detection of 
parameter disturbance. 
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Fig. 12—Mathematical model of parameter servo. 


this closed-loop parameter control by the “parameter 
servo” of Fig. 12. This mathematical model provides in- 
sight into the operation of the original adaptive system. 
In this model, Ad(¢) is the incremental time variation of 
the uncontrollable parameter. The function ®,,,(w) rep- 
resents “noise spectrum,” which includes spectral com- 
ponents neglected in the analysis and also the noise in 
the system. 

We observe that the gain of the parameter servo is 
proportional to the amplitude of the perturbation m, the 
square of the input amplitude R?, the system parame- 
ter, the frequency of the input and the perturbation 
frequency. The time constant in the open-loop case is 
solely dependent on the low-pass filter. Thus, any change 
in the input amplitude and frequency will affect only the 
open-loop gain of the parameter servo. 

The above analysis assumes a constant amplitude 
sinusoidal signal as the input to the system. If it is any 
other signal, the analysis is more complicated, but the 
model of the parameter servo will still be a first-order 
system with a different open-loop gain.'!° The noise 
spectrum ®,,,(w) will also be different. 

If the actual system and model are of higher order 
and only one parameter is controlled, the analysis is 
essentially the same with some minor modifications. '° 

It is important to remember that the mathematical 
model is true only as long as the assumptions made in 
deriving it are valid. In particular, the assumption that 
the disturbance is at a much smaller frequency com- 
pared to the cutoff frequency of the system simplified 
the dynamic model of the adaptive loop. In effect, the 
phase shift introduced at the disturbance frequencies by 
the system is much smaller than that introduced by the 
low-pass filter in the adaptive loop, and was neglected. 
For higher disturbance frequencies, this assumption is 
not valid. Thus, we cannot expect the simplified mathe- 
matical model to predict stability of the over-all system 
under all possible conditions. 

It should also be mentioned that for the simple case 
considered with sinusoidal input, it is not essential to 
use the powerful techniques of Zadeh. The time-varying 

10 V, Rajaraman, “Theory of Parameter-Perturbation Adaptive 


and Optimizing Control Systems,” Ph.D. dissertation, University of 
Wisconsin, Madison, to be published. 
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differential equations can be solved directly using per- 
turbation techniques, leading to the results in this sec- 
tion. However, it is necessary to use the concept of time- 
varying system functions if the analysis is to be ex- 
tended to the case with random inputs. 


IV. EXPERIMENTAL VERIFICATION OF THE PROPOSED 
LINEAR EQUIVALENT OF THE PARAMETER SERVO 


In order to check the validity of the proposed linear 
equivalent for the adaptive loop, simulator studies were 
conducted. The system of Fig. 10 was used with M=0.5, 
a=0.4, 6=0.1, m=0.1 and the input was a sinusoid 
r(t) = R cos nt. As shown in the figure, b was disturbed 
sinusoidally at a frequency A rad/sec. The parameter 
in the model was perturbed at frequency v. In the com- 
puter used, the computer unit of time was 1 msec, so 
that the actual frequencies used, as indicated below, 
are 1000 times greater than if real time simulation had 
been used. 

The first experiment was to check the linearity of the 
adaptive loop in detecting the disturbance. The values 
of 7 and v chosen are 50 cps and 400 cps, respectively. 
FR was held constant at 12.5 volts peak-to-peak. With \ 
fixed at 1 cps, p was varied. The plot of the output of the 
adaptive loop vsp [(a) when the loop is open, and (b) when 
it is closed | are shown in Fig. 13. This demonstrates the 
validity of the assumption of linearity made in the 
analysis. 

The next experiment was to check the equivalent 
form of Fig. 12. In this case, the value of p was fixed at 
0.5. The frequency of the disturbance \ was varied. 
The ampitude and phase of the disturbance signal at 
frequency A detected at the output of the adaptive loop 
(with the loop open) was measured. The effective gain 
of the adaptive loop is the ratio of the amplitude of the 
detected disturbance to the amplitude of the input dis- 
turbance. The phase shift between the input and de- 
tected disturbances was also measured. The individual 
points in Fig. 14 correspond to these measured quanti- 
ties after normalization. The continuous curves cor- 
respond to the normalized gain and phase plots of the 
open-loop parameter servo proposed in Section III. The 
gain and phase for the closed-loop parameter servo are 
also plotted as continuous curves in the same figure. The 
experimentally observed values (normalized) with the 
adaptive loop closed are the individual points. In both 
the open- and closed-loop cases, it is seen that the theo- 
retical analysis predicts closely the experimental ob- 
servations. 


V. MEASUREMENT OF SPEED OF RESPONSE OF 
AN ADAPTIVE SYSTEM 


The measurement of the speed of response of an adap- 
tive system requires that the signals and disturbances, 
as well as system parameters, be specified. In addition, 
a performance measure must be adopted if comparison 
of different systems and/or optimization of the adaptive 
loop is to be attempted. 
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Fig. 13—Check on the linearity of parameter servo. 
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Fig. 14—Amplitude and phase characteristics of parameter servo. 
Individual points represent experimentally observed values. 
Legend: @ open-loop gain; © open-loop phase; closed-loop 
gain; and © closed-loop phase. 


The system chosen for simulator studies of response 
speeds is shown in Fig. 8. The characteristic frequency 
of the second-order system was 169 cps (or 1000 
rad/sec), and the input signal first used was a 100- 
cps sinusoid. The damping ratio of the model, set at 
0.5, was sinusoidally perturbed over a large range 
(2.6 to 1) by a signal at 1150 cps. Because of the rela- 
tively high frequency of the perturbation, the model 
output at perturbation frequency was very small. The 
parameter a of the system was sinusoidally disturbed, 
as given by the equation a@=ao(1+p cos At). Various 
values of p and ) were used to study adaptive speeds of 
response. Mean square error (MSE) between the sys- 
tem and model outputs, or a short-time approximation 
thereto, was used as a performance measure. 

Fig. 15 shows graphs of measured relative MSE of 
the system as a function of disturbance frequency for 
two disturbance amplitudes. The adaptive controller in 
this case is able to substantially decrease the MSE for 
frequencies up to 20 cps, which is about an eighth of the 
system characteristic frequency. Fig. 16 is a series of 
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Fig. 15—Curves connecting the ratio of mean square errors and 
parameter disturbance, for 100-cps sinusoidal input signal, and for 
two values of p, the per unit peak change in parameter value. 
€o2 is the mean squared error (MSE) with no disturbance, e.” the 
MSE with the adaptive loop closed and ¢,2 the MSE with the 
adaptive loop open. 


Fig. 16—Photographs showing the disturbance (lower traces in each 
case) and correction signals (upper trace) fed to the controller 
(obtained with adaptive loop closed). Disturbance frequencies 
are (a) 1 cps, (b) 5 cps, (c) 10 cps and (d) 30 cps. Input to the 
system in this case is a sine wave of 100 cps. 


photographs showing the disturbance (lower trace in 
each case) and the negative of the correction signal for 
p=0.25. In Fig. 16, the disturbance (a) is at \/27 = 1 cps, 
(b) 5 eps, (c) 10 cps, and (d) 30 cps. For the 30-cps case, 
the adaptive control signal has a noticeable component 
at the perturbation frequency, but these high frequencies 
are damped out by the system and do not appear in the 
system output. 

The curves shown in Fig. 15 are for an optimum 
adaptive loop-gain setting for the input level used, and 
for very low disturbance frequencies. Improved results 
at higher disturbance frequencies are possible by ap- 
propriate loop-gain adjustment. Also, because adaptive 
loop gain varies with input signal level, the results ob- 
tained will differ if input level changes, unless the adap- 
tive loop gain is suitably changed. This points up the 
necessity of AGC on adaptive loop, or use of limiters 
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before the integrator.” Effects of input level changes 
may also be reduced by choice of a suitable error cri- 
terion.!+ 

It is also of very great interest to note that under a 
slightly different set of conditions with the system 
operating with a 50-cps input signal, it was found pos- 
sible to have a MSE ratio of 0.5 with a 130-cps disturb- 
ance signal, that is, a disturbance of frequency above 
the input signal, and very close to system cutoff. 

As an additional test, white Gaussian noise, shaped 
by a second-order filter tuned to 85 cps and with a 
damping ratio of 0.5, was used as a system input. Fig. 
17(a) and (b) shows curves for MSE ratio for sinusoidal 
disturbances of two different amplitudes with this ran- 
dom input signal. Results are not as good as for sinus- 
oidal input (Fig. 15) at low disturbance frequencies be- 
cause of the low-frequency random noise which appears 
in the adaptive loop. At higher disturbance frequencies, 
the larger error caused by failure of the adaptive loop 
to follow these higher frequencies masks the low-fre- 
quency noise and results are more comparable with 
those of Fig. 15. 

Fig. 18 shows the parameter disturbance and signal 
feedback to the controller when the input to the system 
consists of a random signal. 

Fig. 19(a) and (b) shows the response to a step dis- 
turbance for the sinusoidal and random input cases, re- 
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Fig. 17—Curves connecting the ratio of mean square errors and 
parameter disturbance. The input to the system is a Gaussian 
random process of mean square value (a) 1.2 and (b) 0.6 units. 


Fig. 18—Sinusoidal parameter disturbance (lower curve) at 1 cps 
and signal feedback to the controller (upper curve) with a random 
input signal to the system. 


1 W. C. Schultz and V. C. Rideout, “Control systems perform- 
ance measures; past, present, and future,” IRE Trans. on AUTO- 
“Matic CONTROL, vol. AC-6, pp. 22-35; February, 1961. 
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spectively. It should be noted that in keeping with the 
analytical results of Section III, the step response tends 
to be that of a first-order system. 

Finally, a random parameter disturbance was used. 
An independent noise source was shaped to give a band 
of disturbance frequencies centered at 3-cps. Fig. 
20(a) and (b) shows samples of the disturbances and the 


resultant correction signals for (a) sinusoidal and (b) 


(b) 


Fig. 19-—Square-wave parameter disturbance, at 1 cps and signal 
fed to controller (upper curve); (a) with 100-cps sinusoidal input 
to system and (b) with random input to system. 


(b) 


Fig. 20—Random parameter disturbance (lower curve) and signal 
feedback to the controller (upper curve) for (a) sinusoidal input 
to system and (b) random input to system. Time scale: 
1 division =200 msec. 
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random system inputs. It is particularly encouraging to 
note that the system works well when both the input 
signal and parameter disturbance are random processes. 


VI. CONCLUSIONS 


The parameter-perturbation scheme of adaptive con- 
trol discussed in an earlier paper has been extended. 
These extensions are the use of model errors, perturba- 
tion of the model,!? and combination with various feed- 
forward, and other, schemes. The use of high-frequency 
perturbation of the model parameter has been shown to 
give an increased speed of adaptation for the system- 
adaptive scheme.!° Perturbing a model is more practical, 
and has the further advantage of eliminating the appear- 
ance of the perturbation at the output of the actual 
system. 

A mathematical model has been obtained using the 
techniques of time-varying system analysis. This model 


2 P. Eykhoff, “Optimizing Control and Process Parameter Esti- 
mation,” Doctoral dissertation, Univ. of California, Berkeley; 1960. 
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is capable of rather general application to parameter- 
perturbation adaptive schemes. The model which turns 
out to be of simple form provides insight into the oper- 
ation of the adaptive loop, and indicates the important 
aspects in its design. Further work along these lines are 
directed at extending the model to cases where: 1) the 
system input is a random process, and 2) the system is 
signal-adaptive (Fig. 4). 

Simulation studies have provided checks on the 
linearized model of the adaptive loop, and have provided 
further information on the behavior of the adaptive 
system with random inputs. In particular, it has been 
shown that this system can correct for parameter dis- 
turbances of frequencies as high as one eighth of the 
system cutoff frequency. 

Further theoretical and simulator studies are being 
conducted on an optimalizing chemical process which 
uses parameter-perturbation techniques. This scheme 
was proposed independently by Box.® It is of interest to 
note that the mathematical model of the adaptive loop 
in this case too, has the same form as the one proposed 
in this paper.?° 


Transfer-Function Tracking and 
Adaptive Control Systems” 


C. N. WEYGANDT} and N. N. PURIt 


Summary—This paper describes a system for determining the 
parameters of a transfer function of the form: a constant divided by 
a polynomial in the Laplacian variable s. The system is described in 
detail for a polynomial of second order, but may be extended to 
polynomials of any order. The system may be realized in terms of 
ordinary analog computer components. It presents the information 
in a form which may be readily inserted into a controller for realiza- 
tion of a general type of adaptive control system. 


I. INTRODUCTION 


HE word “adaptive” has been appearing in the 
[ce of many papers [1 ]-[3], dealing with the gen- 

eral field of control in the past few years. It has 
almost as many shades of meaning as the number of 
papers in which it appears. For the present purposes, let 
us define an adaptive control system as follows: 


* Received by the PGAC, November 15, 1960; revised manu- 
script received, March 9, 1961. This paper is a condensation of part 
of a Ph.D. dissertation at the University of Pennsylvania, Phila- 
delphia, 1961. 

t Moore School of Elec. Engrg., University of Pennsylvania, 
Philadelphia, Pa. 

t Dept. of Elec. Engrg., Drexel Inst. Tech., Philadelphia, Pa. 


Suppose there exists a controlled system where: 


1) The performance of the system is describable by a 
system of equations, but the parameters of the 
equations, and perhaps even their form, are not 
known in detail. 

2) The system is affected in some manner by the en- 
vironment in which it resides. 


Then, the system is adaptive if it is capable of: 


1) Determining its performance equations and the 
effect of its environment in sufficient detail so that: 

2) Some performance criterion shall be always opti- 
mum in spite of arbitrary variations in the effect 
of the environment. 


In particular, we shall confine ourselves to the case 
where the controlled system is describable by a set of 
linear differential equations with coefficients which, 
while they may vary with time because of the effect of 
environment, vary sufficiently slowly so that they may 
be considered constant for the purposes of calculating 
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the performance criterion at any time. The order of the 
system of differential equations need not be known. 

The environment may affect the system, for example, 
through the input, the output or load, or through varia- 
tions in the coefficients. The dynamic behavior of the 
kind of system considered here may be described by a 
differential equation of the form 


r a* 
> dz — % = g(x), 


(1) 

k=1 dt* 

where the a; describe the system, x is the system vari- 

able, and g(x) is any function, linear or nonlinear, of x. 

To control the system, we apply a force f. The equa- 
tion of the controlled system then becomes 


“ 
> dy 


k=1 


d* ne 
= x = g(x, f). (2) 


If we restrict ourselves to linear systems, (2) becomes 


r d* 
>i, ak sre = 


k=1 


— ox + f(x), (3) 


where f(x) is a linear function of x. 

Control is frequently effected by making f(x) depend 
on the difference between the actual x and some desired 
value xo 


a* 


3 Ck He (x — Xo) = 


ea de “) 


ae 
d;, — f(x), 
k=1 op 


where the c’s and d’s describe the controller. For a phys- 
ically realizable controller, m2n. 

Taking Laplace transforms of (3) and (4) with all 
initial conditions equal to zero, we get 


we Cys 
Y ustX = F = ——— (X — X)). 
aye Dh dys 

k=1 


(S) 


Capital letters represent Laplace transforms of cor- 
responding lower case letters. Eq. (5) becomes 


HX = B(X — Xo), 
where 
H-* = >> as* 
k=1 


>» as 

= PRseat aa) (6) 
ye dys 
k=1 

HZ is the transfer function of the system to be controlled, 


or the plant, and B is the transfer function of the con- 
troller. 
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II. A PARTICULAR SYSTEM 


Fig. 1 isa block diagram of a complete system to track 
the transfer function 1/s?+-as+b. The part in the 
dashed lines is an ordinary feedback control system 
with input x» and output x. H is the system to be con- 
trolled or plant, and B is the controller. The open-loop 
transfer function is 


; 2 1 
ee eee see 
e€ Ptestd st+astd 


where a and 0 are particular values of the plant coeffi- 
cients a,;. These are assumed to vary slowly with time 
in an unknown fashion. c and d are particular values of 
the controller coefficients d, which are known con- 
stants. a and 8 are approximations to a and 0. The pur- 
pose of the adaptive part of the system is to force a 
and 6 to be equal to aand b, respectively. This is what is 
meant by tracking. 


(7) 


s*+as+g 
52 


Fig. 1—Block diagram of the complete system. 


The rest of the diagram, representing a system which 
will assure that a=a and B=), will now be described and 
analyzed. The system requires signals from the input 
and output of the plant at p and q, and the application 
of a perturbing signal at P. Access to the controller is 
also necessary to make adjustments in @ and §. 

In general, the system operates as follows. The per- 
turbing signal P is a sinusoid which excites H. The re- 
sulting signal x is fed into 1/H’, and the output of 1/H’ 
is compared with the double integral of the input to H, 
where H’ is an approximate to H. The resulting signal 
Z can be shown (see Appendix II) to be 


Be (a =a) { Msin (ot + al 


+ (6 — B) el) M sin (wi + 0)dt. (8) 

This signal contains information about the deviation 
of a from a, and 8 from 6, combined in one signal. It is 
necessary to separate this information to accomplish 
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separate control of a and B. To do this, Z is multiplied 
by x, and the resulting product is integrated and filtered. 
The resulting signal wg can be shown to be 


ean (9) 


n= 
ug = ( B) sone 


where y is a parameter of the filter. The signal wg is in- 
dependent of a because of the orthogonality property of 
sines and cosines. That is, the average value of 


{ sin wi cos widt = 0 


{ sin? widi = 


Similarly, except that Z is multiplied by Jxdt, we gener- 
ate the signal 


(10) 


Nile 


(11) 


This use of the orthogonality of the sine and cosine of a 
single frequency to extract separate information from a 
single signal for the purpose of parameter tracking is 
believed to be presented here for the first time. 

These signals #,. and ws, when then made equal to 
a/K, and 6/Kg, respectively, give rise to the differen- 
tial equations 


ee. KaM? Kal? 12) 
Qa a = ¢@ 
a : 2a)? m, Die 2 
and 
ie : KaM? KaM? 
Die gah ae a y=) Y (13) 
2a? Ness? 


These equations assure that in steady state, a will 
equal a, and 6 will equal b. The filter parameter y and 
the tracking loop gains K, and Kg can be chosen so that 
changes in a and 6 take place slowly compared to the 
responses of the plant, which justifies the assumption 
that aw and @ were constant in the first part of the analy- 
sis. Fortunately, this requires y to be small, which is 
also the condition for adequate filtering of the multiplier 
output. 

The frequency of the perturbing sinusoid must lie in 
the pass band of the plant transfer function, or there 
will not be enough variation in x to drive the tracking 
loops. If the plant has a natural frequency (or range of 
natural frequencies, since its parameters are assumed to 
vary), this range should be avoided. The perturbing sig- 
nal is a necessary evil of this method. If we want to dis- 
cover the dynamic characteristics of a system, we must 
excite it in some way so that its characteristics are made 
manifest. The perturbation need not be sinusoidal; per- 
haps there are other periodic functions that are known 
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or could be invented that have the same kind of orthog- 
onality properties. 

In practice, the perturbing signal would not have to 
be present all the time—perhaps only for one minute 
out of each hour, or ten minutes out of each day, de- 
pending on how quickly the system parameters change 
with time. 

To complete the description of the system, the signals 


Mex ay Ka 
and 


tp = B/Kep (14) 
are integrated, and the integrator outputs are used to 
adjust the values of a and £, both in the controller and 
in 1/H’. Thus, whenever the perturbing signal is present, 
the system will be adjusted so that its dynamic per- 
formance is independent of the plant parameters. 

If, in addition to the perturbation at P, there isa per- 
turbation at x9 or any other point in the system, it will 
in no way affect the corrective signals from the adaptive 
loops, unless the second perturbation happens to give 
rise to a frequency equal to the frequency w of the per- 
turbation at P. This is why w should not lie in range of 
natural frequencies of the plant. The system described 
and a number of similar variatons have been simulated 
on an analog computer and found to operate very satis- 
factorily. During this simulation, step function pertur- 
bations were inserted at xo, and it was found that the 
tracking loops were not materially affected. 

A first look at Fig. 1 suggests that the tracking loops 
with their many integrations might create a stability 
problem. However, on analysis, the tracking loops give 
rise to (12) and (13), which cannot possibly be unstable. 
Even if higher derivatives of a and 6 were present, a 
proper choice of K, and Kg would make the system 
stable. What actually happens is that the orthogonality 
properties of the sines and cosines make the adaptive 
loops essentially independent of the system to be con- 
trolled as far as stability is concerned. 


Il]. ExtTeENsIons TO HIGHER-ORDER SYSTEMS AND 
MULTILOOP SYSTEMS 


The general method presented here can be extended 
to systems where the denominator is of any order. It is 
necessary to have n/2 different frequencies where 1 is 
the order of the system. This is an improvement by a 
factor of two over other methods which require a differ- 
ent frequency for each parameter tracked. This meth- 
od, however, cannot be simply extended to systems 
where the numerator is not a constant. This is a serious 
limitation. 

The order of the denominator need not be known. If it 
were assumed to be of sixth order, and six tracking loops 
were provided, but it turned out that the system was 
only of fifth order, the sixth parameter would turn out 
to be zero. 
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This general system can be extended to multiloop sys- 
tems where the plant has more than one aspect to be 
controlled. This extension will be the subject of a later 
paper. 

IV. CONCLUSIONS 


A system of parameter tracking has been presented 


which: 


1) Requires the minimum of perturbing signals. 

2) Requires access to the controlled plant only at 
places where such access should be easy in practice. 

3) Is capable of physical realization with standard, 
well-tried analog computer components. 

4) Produces the values of the tracked parameters in 
such a form that they can be readily inserted into 
the controller to complete an adaptive control sys- 
tem. 


APPENDIX | 
ANALYSIS OF TRACKING Loops 


From Fig. 1 the signal F applied to the plant is 


fe? — Be, (15) 
where 
w& 
P= for sinusoidal perturbation, 
s _ w? 
and 
5? 4-as +6 
B= ————_ - 
a cS 
a and @ are considered constant although they vary 
slowly. 
ss ast 6 
eee he paar Gera (16) 
rte? s?+te+t+d 


If the system is a regulating system and we are con- 
sidering incremental variations about a constant set 
point, x»=0. Then 


ee (17) 
sretas+b 

ea + (= )( é ). (18) 
stow? stas+b stetd 


“fiom which 


Xe MS 


2 a w? ‘ 

where M(s) isa ratio of polynomials in s having a fourth- 
degree denominator. The time function corresponding 
to) F 

| (19) 


aX. w= M sin (wi + 6) + transient terms, 


ae —e—- 
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where M= | M(s)|s=j0 and @ is the angle of complex 
number resulting from the substituting of jw for s in 
M(s). The frequency w is so chosen that the transient 
terms have essentially died to zero in one or two cycles 
of the sinusoid. M is really a variable since it contains 
a and 6, but if the system is close to equilbrium, @ is 
nearly a, and @ is nearly 6 so that M will not vary much. 
Hereafter, we will consider that X(t) is a pure sinusoidal 
of constant magnitude. 

Now let us compute 


<="). (20) 


stas+ob 


The s? is inserted in the denominator of 1/H’ to make 
it readily realizable with analog computer components. 
In a more general case, the denominator of 1/H’ would 
be s” where 1 is the degree of the polynomial being 


tracked. 
G=e@ = 
2(s) = x) [2 4], (21) 
and the time function corresponding to Z(s) is 
Z(t) = (a — a) { M sin (wt + 0)dt 
+ (6 — 8) ff M sin (wt + @)dd, 
or 
M 
Z(t) = — (a — a) — cos (wt + A) 
(63) 
M 
— (b — B) a sin (wt + @). (22) 
(2) 


This is (8) in the body of the paper. 

The next step is to multiply Z(t) by X(t). In the i 
quency range of most control systems, this can be done 
with a servo-multiplier. 


Zi X(t) = — (a — a) eae (wt + 8) sin (wt + 8) 


M2 
— (b — B) “a sin? (wt + @). (23) 
(6) 

This result is now integrated indefinitely. It would be 
nice to integrate over a definite integral number of pe- 
riods of sin wf, but no equipment is presently available 
for doing this. 


2 


pe ned 
[ axa = —( — £8 5a 


+ terms in sine and cosine of 2wf. (24) 
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Similarly, 


i} A| xa at = el Ciao) — 


-+- terms in sine and cosine of 2wt. 


(25) 


These results are now passed through a filter to re- 
move the second harmonic terms. A filter having a trans- 
fer function y/(s+) will suffice. This filtering action is 
described by 


M2 
— tte + Ug = (a — a) (26) 
¥ 2w? 
Be M? 
— tig + ug = (b — 8) — (27) 
y 2w* 
where uw, and wg are the filter outputs. If we now set 
a B 
tea ==. 95 Ug = ) 
1a Kz 
we obtain: 
; K,.M? K,M? 
at+yata y=a oY (28) 
2w? 2w? 
. ; Kee K,M? 
(oie sag fee emt y= Y; (29) 
20” 2” 


which are (12) and (13) in the body of the paper. 
The final step is to integrate uv, and ug obtaining 


= Ka fail 
B = Ky [adi 


These signals are used to position servo-driven potenti- 
ometers which are used to synthesize B and 1/H’. 


(30) 


R 
| 


and 


(31) 
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APPENDIX II 
List oF SYMBOLS 


a,=coefficients characteristic of the physical 
plant, 
Cn, dn = coefficients characteristic of the controller, 
f=the force applied to the plant, 
g=a general functional relationship, 
B=the controller transfer function, 
H =the plant transfer function, 
H’'=an approximation to H, 
K., Kg=tracking loop gains, 
M =the magnitude of a sinusoidal perturbation 
at the plant output, 
P =the Laplace transform of the perturbing sig- 
nal, 
a, b=plant parameters, subject to change, 
c, d@=controller parameters, constants, 
€=xXo)—x =an error function, 
=the Laplacian variable, 
Ua, Ug =filter outputs, 
x =the plant output, 
xo =the system input, 
=the tracking loop error function, 
a, 8=approximations to a and b, 
y =the filter parameter, 
6=the phase angle of the perturbation of the 
output, 
w =the frequency of the perturbation. 
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Adaptive Servo Tracking” 


A. I. TALKIN}, MEMBER, IRE 


Summary—This paper describes a self-adaptive sampled-data 
radar tracking loop. The adaptive tracking loop may be considered to 
be a low-pass filter with a variable bandwidth. The loop is designed 
to adapt rapidly to changes in the input signal by monitoring both the 
apparent error and the loop output. 

Results show a mean tracking accuracy 25 to 34 per cent higher 
than that of a comparable linear system at a receiver SNR of 10 db. 
In other terms, to attain the same accuracy the comparable linear 
system requires a SNR of 13 db. This improvement in perform- 
ance is obtained with relatively little additional circuitry. In general, 
the degree of improvement obtained by adaptive tracking will depend 
on the compromises made in the design of the unadapted loop to 
track the most difficult type of target. 


I. ORIGIN OF PROBLEM AND OBJECTIVE 


HIS investigation developed as an offshoot of a 

track-while-scan radar project. The radar system 

was designed to obtain as high a tracking accu- 
racy as possible, particularly in angle, in order to use the 
data for missile guidance. The angle and range tracking 
loop configurations are identical in this radar, with 
practically no mutual effects between them as long as 
the target is held in track by both. The work described 
was applied to angle tracking only, but the results are 
equally applicable to range tracking. The tracking loops 
include two operational amplifier integrators in a type 
II servo loop, yielding zero position error and zero ve- 
locity error in tracking a noise-free constant velocity 
signal. The design of the type II tracking loop involved 
specifying the roots of a characteristic equation of sec- 
ond order, or equivalently, specifying two arbitrary 


~_ parameters. In the article by Smith, ef al.,1 which pro- 


me 


vided the basic tracking loop design, the parameters 7 
and k were used rather than the roots themselves. The 
relation between the roots of the characteristic equa- 
tion and the parameters j and is given by 


4j? — 2k -—1 4+ SA + 2k + 4/1 + 2h — 4) 
47? 


Bile oh 


It has been shown? that the tracking loop acceleration 
error coefficient equals 7°72, where 7 is the scan interval. 
The value of j is determined from the relation 7? = C/7’q, 
where C is the tracking gatewidth? dictated by the radar 
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Bars iranitae aoe that can be tolerated before the prob- 


ability of breaking track becomes high is given by the gatewidth. 


beamwidth and the desired target resolution, and a is 
the effective target acceleration seen by the tracking 
loop for the most unfavorable target trajectory that is 
tactically feasible.‘ A particular target trajectory chosen 
for most of the experimental tests is described in Sec- 
tion IV. The value of k may be selected to give the best 
noise filtering or to minimize the error peak, when the 
target executes a turn. The article by Smith, ef al.,1 
shows that for best noise filtering (for the case of white 
noise), k=j. However, this choice results in a higher 
peak error on the turns than the critically damped re- 
sponse (specified by k=2j—4). The critically damped 
response was the one selected as a reasonable compro- 
mise for the design, since it is important to minimize 
servo error peaks on turns to prevent the combined 
noise and servo error from exceeding the tracking gate- 
width, with a consequent high probability of breaking 
track entirely. If it were not for the restriction on the 
maximum acceleration lag 7?7?a, the noise response of 
the loop could be reduced by making j as large as possi- 
ble while still maintaining the relation k=2j7—4. It is 
apparent that an adaptive system is possible by having 
j large until the target accelerates, then decreasing 7 as 
target acceleration increases, varying k simultaneously 
to maintain the relation k=27—4. This is equivalent to 
having a variable bandwidth filter that rests at a preset 
minimum bandwidth until signal accelerations force the 
bandwidth to increase. Such an adaptive filter offers 
the possibility of greater noise reduction and, conse- 
quently, higher tracking accuracy than the comparable 
system with fixed parameters. Experimental test re- 
sults verify the above hypothesis. Data taken to com- 
pare the performance of the adapted and unadapted 
loops show that the adapted loop will track a target at 
7-db SNR with the same integrated absolute error as 
that of the unadapted loop in tracking the same target 
at 10-db SNR. Details of how the performances of the 
two systems are compared are discussed in Section IV. 


II. Previous Work IN Tuts FIELD 


Although the design of adaptive systems is a rela- 
tively new field, there already exist a large number of 
papers’ presenting complex analyses of the various as- 
pects of adaptive systems. Adaptive loops that will fol- 
low polynomial signals of predetermined degree in the 


4QOne such trajectory would occur for a target executing its 
maximum evasive maneuver, generally a 90° turn just before ex- 
pected intercept by the defending missile. 
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presence of Gaussian noise of known power spectrum 
are described by Drenick and Shahbender.® An accelera- 
tion estimator is designed based on the Zadeh-Ragaz- 
zini theory of prediction, and the control voltage output 
of the estimator is used to vary the main loop param- 
eters to maintain an optimum relationship among 
them, which relationship is based on assuming steady- 
state conditions. In our problem, no steady state of con- 
stant acceleration can exist. It turns out that approxi- 
mating the second derivative of the main loop output 
by cascading two RC filters is an adequate measure of 
signal acceleration. Certainly, from a practical stand- 
point this is simpler than designing and realizing an 
optimum predictor. 

Roberts’ has designed an adaptive, or self-optimizing 
control system based on the Wiener theory. That 1s, 
the power spectrum of the signal is assumed to be 
known. The optimum linear system is shown to be de- 
pendent on the ratio of the mean square levels of signal 
and noise (for white noise). When these levels are not 
known in advance or are slowly varying, the optimum 
adjustment may be maintained by forcing the apparent 
error® power spectrum to be white. This is accomplished 
by separating the low- and high-frequency components 
of the error and developing a control voltage whenever 
the absolute values of the low- and high-frequency error 
components are unequal. The treatment is largely con- 
cerned with self-optimization with constraints on the 
output acceleration. Such considerations are important 
where mechanical or electromechanical elements are in- 
volved. The tracking loop discussed in this report is an 
all-electronic one, and, hence, is unaffected by mechani- 
cal component limitations. 

A basic principle of adaption, forcing the apparent 
error to be white when the noise is white’ carries over to 
the problem treated herein. However, the technique by 
which it is accomplished is considerably different from 
that of Roberts,’ basically because of the different input 
signal characteristics in the two problems. 


III. DETAILS oF PRESENT APPROACH 
A. Technique for Operating Along a Locus 


Fig. 1 represents the basic type II tracking loop that 
is the subject of this paper. 

Fig. 2 is a reproduction from Smith, e¢ al.,! showing 
typical step function responses for various choices of 
parameters 7 and k. Fig. 3 is a possible modification of 
the basic loop to permit operation with any effective 
values of j and k simply by varying the control voltages 
(M, N) into the three electronic multipliers. 


®6R. F. Drenick and R. A. Shahbender, “Adaptive servomecha- 
nisms,” Trans. AITEE, vol. 76 (Applications in Industry), pp. 286- 
292; November, 1957. 

7A. P. Roberts, “Self-Optimising Control Systems for a Certain 
Class of Randomly Varying Inputs,” Royal Aircraft Establishment, 
Farnborough, England, Tech. Note No. G.W. 507; January, 1959. 

8 The apparent error is the difference between the input signal 
plus noise and the loop output. 
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Fig. 1—The basic type II linear tracking loop. 
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Fig. 2—Step response of two-stage sampling servo. Figures in inset 
diagrams are approximate values of roots of characteristic 
equation. 
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Fig. 3—Generalized loop for operation along any locus. 
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The relations between & and j and the circuit param- 
eters in Fig. 1 are given by 


Ue, 
Pe aN RCi RC» (1) 
T 


and 
k Sy 1 Cir (2) 


where 7 is the time between samples (500 msec in our 
system). 

j and k may be varied by varying the effective values 
of b and r. Let j, k correspond to an initial operating 
point specified by (1) and (2). Define a capital J, K by 
the relations 


J=7/M and K = Nb. (3) 
Then 
2 Sen rem (4) 
Mr 
eee Nel). (5) 


To operate on the locus K =2/—3, 


AGA pe ees 
NrC,/r a V/RiCi RC = 1) (6) 
Mr 
or 
: h T (7) 
ST Ce 
where 
2b-/ RiCi R2C2 
LS aR etgatee ia (8) 
rCy 


Fig. 4 shows the loop configuration for operation along 
the specific locus, K =2/—4%. Note that only two multi- 
pliers are necessary. The multiplication by 1/M required 
by (7) is equivalent to taking part of the signal to the 
final integrator from the first multiplier. 


B. Definition of Standard Target Trajectory 


It was not considered realistic to represent the target 
trajectory of a single aircraft either by a power spec- 
trum or a polynomial of known degree. Actually, the at- 
tacking aircraft will fly a relatively straight course, 
with a slight possibility of one evasive maneuver just 
before reaching the expected intercept range by a de- 
fensive missile. Thus the problem is to design an adap- 
tive loop with a minimum bandwidth for tracking tar- 
gets flying practically straight courses, and which has 
the capability of rapidly and continuously increasing 
its bandwidth to maintain track should the target go 
into an evasive maneuver or should acceleration be- 
come important because of the closing of the target 
range. As a result of these considerations, a standard 
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Fig. 4—Loop configuration for operation along locus K =2J—3. 


moving target trajectory was specified. The trajectory 
is that of an aircraft flying at 420 mph on an arc witha 
radius of 14 nautical miles from the radar. The target 
makes a 180° turn at each end of its trajectory, using its 
maximum turning acceleration of 4 g. 

The target signal was generated by passing a 0.005- 
cps symmetrical triangular waveform through an RC 
filter of 0.02-cps corner frequency. The target then is 
moving at a constant angular rate of 0.44 degree per 
second for about 86 seconds, and then makes a U turn 
in another 15 seconds. The acceleration going into the 
turn is much greater than that coming out of the turn. 
This is considered to be a more realistic simulation of 
true air flight than a symmetrical turn.® It represents a 
greater challenge to the adaptive system since there is 
less warning of a turn available in the signal. Tracking 
error is measured by integrating the absolute value of 
the error over a period of 6 minutes and 44 seconds, or 
two complete round trips of the target. The input signal 
waveform is illustrated in Fig. 5. 


C. Noise Spectrum and Scintillation 


The noise that is superimposed on the echo pulses is 
receiver noise with about a 3.5-Mc bandwidth. The tar- 
get signal for angle tracking is developed by boxcarring 
the return video burst consisting of 4-usec pulses with 
superimposed receiver noise. Since there can be but 
negligible correlation in the noise from pulse to pulse 
(since the pulses are 500 wsec apart), there cannot be 
any correlation in the noise from scan to scan (500 msec 
apart). Hence the correlation function of the noise is a 
delta function and the noise, as far as the tracking loop 
is concerned, can be considered white. 

In addition to receiver noise, the tracking loop must 
cope with signal scintillation, a random variation in the 
amplitude of the return. If there were no receiver noise, 
such variations could be prevented from influencing the 
tracking by normalizing the error from the discrim- 

9 See W. M. James, N. B. Nichols, and R. S. Phillips, “Theory of 


Servomechanisms,” M.I.T. Rad. Lab. Ser., McGraw-Hill Book Co., 
Inc., New York, N. Y., vol. 25, pp. 300-301; 1947. 
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output of acceleration estimator 


Fig. 5—Characteristics of input signal to the tracking loop. 


inator. This has been done, but the normalization, of 
course, loses its effectiveness in the presence of receiver 
noise. Essentially, the effect of scintillation is to de- 
crease the effective SNR. The data to be discussed in 
Section IV were taken for a nonscintillating target in 
the presence of receiver noise. Data taken with a scin- 
tillating target show the same absolute value reduction 
in integrated error by using an adapted loop, but the 
per cent reduction of error is less since the error for both 
adapted and unadapted tracking is increased. 


D. Adaptive Technique (the Two Complementary Con- 
trol Channels) 


The adaptive schemes*” examine either the servo 
input or the apparent error, processing one or the other 
of these signals through a filter (which may be fairly 
complex) or a computer, and using the filter or com- 
puter output to vary the parameters of the main loop. 
A more effective way to adapt in this problem proved 
to be by examining both the apparent error and main 
loop output. 

The first approach was to examine only the apparent 
error with a smoothing filter and to make the main 
loop bandwidth proportional to the absolute value of 
the filter output. When the filter output was zero, the 
loop bandwidth was set at the minimum value required 
to maintain track in the presence of main loop inte- 
grator drifts and internal offsets. A limit was also set on 
the maximum bandwidth that the adapted loop may 
have. This limit was set somewhat below the theoretical 
upper limit of one half the sampling frequency. This 
was done to prevent single isolated noise pulses from 
causing unduly large errors. The adaptive system varies 
its 7 value from 2.5 to 8, corresponding to a bandwidth 
variation of about 3 to 1. 

Experiments were made with a variety of impulse re- 
sponses for the smoothing filter, but the improvement 

over unadapted tracking was marginal. This was pri- 
marily caused by the fact that the smoothing time of 
the filter had to be fairly short (2 or 3 seconds) so that 
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the main loop bandwidth could increase rapidly enough 
to maintain track when the target went into its turn. 
As a result of the short smoothing time, the filter output 
was unduly noisy in the target straightaways. 

The next experiment was to obtain an early indica- 
tion of target acceleration by a double differentiation 
of the main loop output and to use this signal to increase 
main loop bandwidth. This does permit tracking to be 
maintained in the turn, but the acceleration signal de- 
creases rapidly in the later or leveling-out portion of the 
turn. Hence, the bandwidth falls too rapidly with a 
consequent long-duration tail transient as illustrated 
im Pig.6: 

Only by using both the above techniques could sig- 
nificant reductions in tracking error be obtained. The 
bandwidth is now expanded when either or both of these 
complementary sensing or control channels produce an 
output. Since warning of acceleration was obtained from 
the main loop output, the smoothing filter time con- 
stant operating on the apparent servo error could be 
increased from 2 to 20 seconds. The complementing ac- 
tion of the two control channels is as follows. On entering 
the turn, the high-frequency loop increases the band- 
width to prevent losing track. After the initial sharp 
acceleration is over, the output from the high-frequency 
channel has gone to zero, but at the same time the low- 
frequency channel has had time to build up, thus rap- 
idly eliminating the tail transient at the end of the 
turn. The reduced tail transient is illustrated in Fig. 7. 
Fig. 8 illustrates what happens when only the low-fre- 
quency control channel is active. Note the large initial 
error, but the rapid recovery. 

The gains of the two control paths are determined ex- 
perimentally by observing the servo error waveform in 
the turn and increasing the high-frequency loop gain to 
give a satisfactory initial error waveform, and increas- 
ing the low-frequency loop gain to give a satisfactory 
tail transient. These gain settings were not particularly 
critical,!° but the lowest gain giving a satisfactory error 
waveform should be the best for performance in the 
presence of noise. Fig. 9 is a simplified schematic draw- 
ing showing the complete adaptive servo configuration. 


IV. RESULTS AND DIscussION 


A. Basic for the Comparison of the Adapted with the 
Unadapted Loop 


In comparing the performance of the adapted with 
that of the unadapted loop, the question arises how to 
select the parameter j of the unadapted system to have 
a fair comparison. It is both logical and convenient 
from a practical standpoint to select that j value for 
the unadapted loop that equalizes the integrated abso- 


_ 7°A limited amount of data were taken showing that a 2-to-1 
increase in gain of the low-frequency channel did not change the 
integrated absolute error at 10-db SNR. 
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Fig. 10—Tracking through a turn, with unadapted loop. [Area of 
tracking error waveform adjusted via control voltage to equal 
that in Fig. 6(a).] 


Fig. 6—Tracking the noise-free standard target through a turn, 
with only the high-frequency control channel active. [Note slow 
recovery in (a).] 


lute servo error of the two systems in tracking the 
noise-free standard moving target. This equalization 
was obtained at j=3. The error waveform in the turn 
for this unadapted loop is illustrated in Fig. 10. 

The performances in the presence of noise may now 
be compared. 
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aoe ae 1) Standard Moving Target: A 10-db SNR was chosen 
PEA for most of the measurements with some additional 


Wate Cee data taken at 7-, 8-,42-, and 13-db SNR. At 10-db 
Fig. 7-Tracking through a tw, with both high-and low-frequency SNR, the error of the adapted loop averages 25 per 
cent less than the unadapted loop error. Alternately, 
the adapted loop will track at 7-db SNR with the same 
average error as the unadapted loop at 10-db SNR, or 
the unadapted loop requires a 13-db SNR to track with 
the same error as the adapted loop at 10-db SNR. 
2) Stationary or Constant Velocity Target: In tracking 
a stationary target at 10-db SNR, the adapted loop error 
is 34 per cent less than the unadapted loop error. This 
improvement should be maintained also in tracking a 
constant velocity target, since the basic loop is of type 
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bandwidth of the unadapted loop to the minimum 
bandwidth of the adapted loop. The formula is 
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loop, and B, is the bandwidth of the unadapted loop. 
This formula is easily derived, assuming white noise in- 
put and rectangular band-passes. The noise power out- 
put is then just proportional to bandwidth. Substitut- 
ing in the formula the j ratios for the bandwidth ratios, — 
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Fig. 9—Simplified schematic of complete adaptive servo. results in a maximum improvement of 40 per cent. 
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A summary of some typical data is given in Table I. 
The numbers given are the integrated absolute value of 
the errors over 6 minutes and 44 seconds, the time re- 
quired for two complete target round trips. Only the 
relative values are significant; the absolute levels are 
determined by the gain of the error integrator. 


TABLE | 
RELATIVE TRACKING ERROR 


A. Standard Moving Target 


SNR c) 13 db 10 db 7 db 
Unadapted 30 70 92 = 
Adapted 30 — 68 91 
Manually adapted = — 69 = 

B. Stationary Target 
SNR 10 db 
Unadapted 83 
Adapted 5S) 


3) Manual Adaption: In order to have some yard- 
stick against which to measure the performance of the 
adaptive system in tracking the standard target, experi- 
ments were made with a manually adapted loop. That 
is, the loop bandwidth was switched to its maximum 
value (j=2.5) just before the target went into its turn, 
held at the maximum for the duration of the turn, and 
then switched back to its minimum value (j=8) for the 
straightaway. This experiment was carried out at 10-db 
SNR and gave no further reduction in error over the 
automatically adapted loop. Although a further reduc- 
tion in error should be expected with the manually 
adapted loop, it is probably so slight that a considerable 
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number of runs would be required to establish the 
amount of improvement. 

4) Hardware Required for Adaption: Fig. 9 shows that 
two 2-quadrant multipliers and two operational ampli- 
fiers are required to adapt the main loop. The two 
multipliers are transistorized plug-ins with dimensions 4 
inches by 2 inches by 1? inches. Their design has been 
presented by Ravilious." Evidently, adding adaptivity 
to a radar tracking loop is not unduly costly. 

5) Applications: The ideas used to produce an effec- 
tive adaptive servo or variable bandwidth filter could 
be applied to any servo or filter that has to deal with a 
signal corrupted by noise, and where the upper fre- 
quency cutoff is set by the possibility that there may 
be high-frequency components in the signal that must 
be accepted. Radar tracking probably presents the 
greatest field for application of this type of adaptation. 
On radar systems where the tracking accuracy is ade- 
quate, the adaptive loop can yield the benefit of in- 
creased tracking range or increased immunity to wide- 
band noise jamming. 


CONCLUSION 


It has been demonstrated experimentally that it is 
possible to increase the accuracy of a type IJ radar 
tracking loop by adaptive control of the bandwidth. 
The fast reaction required of the adaptive part of the 
loop can be obtained with no sign of instability in the 
main loop. In this investigation, main loop stability was 
secured by operating along the locus of critical damping. 


1C. F. Ravilious, “Four-Quadrant Analog Voltage Multiplier,” 
Diamond Ordnance Fuze Labs., Washington, D. C., Tech. Rept. 
No. 838; May 16, 1960. 
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Precision of Impulse-Response Identification Based 
on Short, Normal Operating Records’ 


R. B. KERRY, MEMBER IRE, AND W. H. SURBER, JR.}, MEMBER, IRE 


Summary—The characteristics of a process may be estimated 
from an observation over a finite interval of time of the input and 
output variables of the system during a period of normal operation. 
The determination of the most effective method of analyzing the ob- 
served data and of estimating the probable errors in such an analysis 
is an important problem in the study of complex processes and in the 
design of adaptive controllers for time-varying systems. For adaptive 
control systems, it is desirable to base this system “identification” 
analysis on as short an operating record as possible, consistent with 
the specified degree of accuracy to be obtained. This paper is con- 
cerned with the problem of impulse-response estimation based on 
such short “normal operating” records. 

If the measurements of the system variables are corrupted by 
noise, the impulse-response parameter estimates will be random 
variables, since, for a given record length, these estimates vary from 
one sample of the observed data to the next, depending on the varia- 
tion in the characteristics of the noise and the input signal during 
each short segment of the record. The expected “integrated-squared- 
error” between the actual and the computed impulse responses is 
shown to depend only on the input signal and the noise characteris- 
tics. A method of computing the expected-integrated-squared error for 
a given input signal is developed to provide a test of the reliability 
of the identification routine for each analysis. With assumptions on 
the statistical nature of the input signal, this “sufficient signal” cri- 
terion is transformed to a “sufficient record length” criterion. Exam- 
ples are given for two such specific assumptions: 


1) An input signal with a Gaussian amplitude distribution. 

2) A switching-type input signal which jumps between +1 and 
—1 with a random distribution of switching times. Results are 
presented in sampled-data form. 


I. INTRODUCTION 


HE problem of identifying the dynamic charac- 
‘hoes of a process by observing its input and 

output variables over a finite period of time during 
normal operation is a very important one in a number of 
fields. In the study of complex processes, where the de- 
termination of a suitable mathematical model for the 
system is the basic objective, relatively long record 
lengths may be used, thus enabling the signals to be 
described statistically. For an adaptive control system, 
where the controller is operating on a real time scale, it 
is very desirable to base the identification program on 
the observation of the system operation over as short a 
time interval as possible, consistent with the desired 


* Received by the PGAC, December 15, 1960; revised manu- 
script received, March 13, 1961. This paper is based upon research 
work sponsored by the Aeronautical Research Associates of Prince- 
ton, Inc., Princeton, N. J., for General Precision Inc., New York, 


+ Dept. of Elec. Engrg., Princeton University, Princeton, N. J. 


degree of accuracy in the estimation of the system 
parameters. This is particularly true if the system 
characteristics are varying with time and a time-in- 
variant model is to be used to represent it approx- 
imately. | 

The primary objective of the process-identification 
program is the estimation of a set of parameters which 
will enable the future behavior of the system in response 
to its input or control signal to be predicted satisfac- 
torily. If this is the case, then sufficient information is 
available to design the controller, z.e., enable the proper 
value of the manipulated variable to be determined as a 
function of the input signal and the current state of the 
process. If the characteristics of the system are varying 
sufficiently slowly with time, relative to its “memory” 
time or settling time 7, and if sufficiently “short” ob- 
servation and prediction intervals are used, the system 
model may be assumed to be time-invariant. The sys- 
tem is then represented by a sequence of such models, 
the parameters being recomputed at intervals. It is also 
desirable to base the parameter estimates on records of 
the “normal” operating signals. There may be periods, 
however, when the nature of the normal control signals, 
due to either low amplitudes or certain waveform prop- 
erties, are such that a sufficiently accurate estimate of 
the parameters cannot be made from the desired ob- 
servation interval. It should be possible to detect these 
cases by a suitable computer routine in order to prevent 
the use of unreliable data by the controller. The para- 
meter-estimation routine could then either by automati- 
cally extended over a longer interval, or special test sig- 
nals could be deliberately injected. The discussion in 
this paper will be restricted to the use of normal operat- 
ing records for parameter estimation. 

For short-duration records, a strictly statistical de- 
scription of the input and output signals is precluded. 
A conflict of requirements arises, in fact, since it is de- 
sirable to use as long a record as possible for noise 
smoothing, but as short a record as possible so that the 
system may be assumed to be time-invariant over the 
estimation interval. Hence, for a given rate of parameter 
variation, a given noise level, and a given type of con- 
trol signal variation, there should exist an optimum 
record length if an approximate time-invariant model 
is to be used to represent the system for a definite time 
into the future, z.e., until the results of the next compu- 
tation of parameters are available. 
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Il. ASSUMPTIONS AND SOURCES OF ERROR 


The type of system to be analyzed is indicated in Fig. 
1. For a control system, where the magnitude of the 
input forcing function is normally limited by some form 
of saturation, it is assumed that the effective control 
signal after the limiter is available for observation. A 
suitable transfer function for the linear part of the sys- 
tem is to be determined. The effects of random disturb- 
ances applied throughout the process and of measure- 
ment errors in observing the output are represented by 
the equivalent noise generator n(t), which is mixed 
with the ideal output signal. 
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tages of the g(t) model are, first, that it involves the 
minimum number of assumptions concerning a specific 
structure for the model and, second, the relative ease 
with which other equivalent or simpler sets of param- 
eters characterizing the system dynamic response can 
be computed from g(t). The number of parameters re- 
quired and their accuracy depend, of course, on the type 
of controller that is to be used and the degree to which 
it is desired to approach optimum performance. 

In order to describe g(t) by a finite number of param- 
eters, it will be assumed that the system has a finite 
settling time 7,, beyond which the g(t) function is 


LINEAR PROCESS y(t) 
g(t) ; 


i) Observed 


Output 


Fig. 1—System to be analyzed. 


The system equations for this configuration are 


“@) = f eae (1) 
and 


y(t) = a(t) + n(Z), (2) 
where 


g(t) =impulse response of the linear part of the sys- 
tem, 

x(t) =input signal to linear part of the system, 

z(t) =output variable in the absence of noise, 

n(t) =equivalent noise signal, 

y(t) =observed output variable. 


There are a number of different types of mathemati- 
cal models that could be selected to represent the dy- 
namic process characteristics. The identification rou- 
tine then estimates the values of the parameters for the 
given model to obtain the “best” fit to the observed 
noise-corrupted data in some sense, such as a least- 
squares fit between the observed system trajectory in 
its phase space and the model trajectory for a given 
input signal. Certain types of models, however, impose 
very stringent requirements on the behavior of the out- 
put variable from the model. If the model were assumed 
to be a second-order linear differential equation, for 
example, even the best choice of the model parameters 
might result in an unsatisfactory representation of a 
higher-order system. The impulse response character- 
istic g(t), by contrast, seems to be a very suitable form 
of linear system representation for the study of the ef- 
fects of noise on the parameter estimates. The advan- 


negligibly small, and that the system has a finite sig- 
nificant bandwidth. 

The sources of error in the impulse-response identifi- 
cation may be classified as follows. 


A. Noise and Measurement Errors 


The effects of noise, as represented by n(t), on the 
accuracy of parameter estimation will be discussed in 
detail in the remainder of this paper. As the length of 
the observed record is increased, thus increasing the 
number of effectively independent data samples, the 
precision with which the set of parameters is estimated 
increases. This type of noise smoothing is a function of 
the degree of redundancy in the data, 7.e., the number of 
independent output data samples relative to the num- 
ber of parameters to be estimated. 


B. Model Structure Errors 


1) Finite Settling-Time Assumption: If the assumed 
settling time 7’, is too long, the apparent number of pa- 
rameters to be estimated will be increased. In addition to 
the increased computer capacity required, the decrease 
in redundancy for a given observation interval de- 
creases the effective noise smoothing and results in 
poorer precision. If 7’, is too short, however, a system- 
atic error will be introduced into the estimates of the 
retained parameters. The best choice of T, for a fixed 
measurement interval 7, would be obtained by reduc- 
ing 7, thus increasing the apparent redundancy of the 
observed data and decreasing the fluctuations caused 
by noise, until the systematic error became of the same 
order of magnitude as the expected noise-induced esti- 
mation error. 
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2) Finite Bandwidth Assumption: If the system is as- 
sumed to have an effective upper cutoff frequency f, 
above which the output 2(¢) will not respond signifi- 
cantly (z.e., the energy in the components of z above 
this frequency is negligible relative to the noise energy), 
then g(t) may be represented by a set of values of g(t) 
separated at intervals of time At = [1/(2/,) ] with a negli- 
gible loss of information. If At is chosen to be smaller 
than this, due to our initial ignorance of the actual system 
characteristics, then a larger number of parameters will 
apparently be required for a given 7, since N =(T,/At) 
is the number of gz values which must be estimated. In 
addition to requiring a faster sampling rate and a 
greater computer capacity, this increases the expected 
error in the parameter estimates, for white noise, essen- 
tially in proportion to the square root of the increase in 
N, for a given measurement interval 7,,. Although the 
redundancy in the observed data remains almost con- 
stant, being determined primarily by the ratio of 7, to 
T, (which does not change as At is varied), the change 
of the output variable z(t) becomes relatively less from 
sample to sample, thus increasing the effect of the noise 
fluctuations. A quantitative example is given in the Ap- 
pendix for a very simple structure of the input signal 
x(t). The same conclusion can be reached using another 
approach, by observing that the short A¢ interval allows 
less filtering of the observed output y(t) in determining the 
values of the output data samples, thus increasing the 
effect of the noise energy relative to the signal energy. 
This effect is very closely analogous to the problem of 
the choice of a Af interval in the estimation of the fre- 
quency response characteristics of the system, a prob- 
lem which has been extensively discussed in the litera- 
ture.’ 

If At were to be increased beyond the [1/(2f,) | inter- 
val, this increase would introduce a systematic structural 
error in the determination of the equivalent model, 
since the fine structure of the system g(t), 7.e., the high- 
frequency response characteristics, would be smoothed 
out and, therefore, lost. The expected error in the 
parameter estimates due to noise induced fluctuations 
would be decreased, however. Again, as in (1), a “best” 
choice of At might be considered to be one which would 
approximately equalize the noise-induced and the sys- 
tematic expected errors. 

3) Time Variation of the System Parameters: It is as- 
sumed in the analysis in later sections that the process 
parameters are constant over the measurement interval 
T,,. The controller, for an adaptive system using this 
identification routine, would also assume that these 
estimated parameters remain time-invariant over the 


1 R. B. Blackman and J. W. Tukey, “The measurement of power 
tra from the point of view of communications engineering, 
Bell Sys. Tech. J., vol. 37, pp. 185-282, January; pp. 485-569, March, 
1958. 
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prediction interval as well. The actual parameters must 
change sufficiently slowly with time relative to the de- 
gree of accuracy required by the controller for this as- 
sumption to be valid. 


C. Sampling Time and Computation Time Delays 


If the system variables are coupled to the identifica- 
tion computer through analog-to-digital conversion 
transducers and sampled at intervals of At, an effective 
sampling delay of (At/2) is introduced by the data 
acquisition system. An additional computation time 
interval would elapse before the controller received 
each set of results. 

The effective sampling delay (At/2) is due to the 
need to filter, or smooth, the actual signals before sam- 
pling in order to avoid frequency aliasing with a conse- 
quent increase in the noise fluctuations per sample. Al- 
though this delay could be avoided by postulating an 
idealized sampled-data system, using an impulse train 
for data sampling, this might be highly undesirable in 
practice. 

One method of obtaining the samples of y(t) would be 
to average y over each interval At as indicated in 


tk 


Vi y(t) dt, (3) 


At J (t,—at) 


so that y; represents an estimate of y(t) delayed by 
(ZAt) behind the time ¢, at which the sample becomes 
available to the computer. 

For a finite settling time 7, and a finite sampling 
time At, (1) may be modified as follows: 


a(l) = if ao ideo i 


or, in sampled-data form, 


Yi 


vc cine oA aL 


N-1 


my =) DS eombas (4) 
n=0 
where 
(n+1) At 
ee if g(a (5) 
nAt A 
and 
Vit = Sk ewer (6) 


For the sampled-data formulation of the identifica- 
tion problem, for which the number of impulse-response 
parameters to be estimated is N=(7,/At), the mini- 
mum number of input samples observed must clearly 
be [V+(N—1)]=(2N—1), in order that a complete 
set of NV equations be formed from (4), as indicated in 
Fig 2: 
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g(t) 


(c) 
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May 


x(t) 


y(t) 


tats (men-1)-at 


Fig. 2—Sampled-data notation. (a) Impulse response. (b) Continuous 
signal records. (c) Sampled-data sequences: x; and 4; are available 


to computer at time f,. 


Any additional data samples observed, by using a 
longer 7,, interval, will allow the formation of an excess 
number of equations relative to the number of inde- 
pendent parameters to be computed. This redundancy 
can be used for noise smoothing, as outlined in the fol- 
lowing section. It is convenient to define a “redundancy 
factor,” R, as follows: 


ri-CS)-[O-) 


N =(T,/At) = minimum number of output samples, 
(2N—1)=minimum number of input samples, 
M=total number of observed output sam- 
ples, 
r= (M—N)=number of excess output samples. 


where 


If M and N are expressed in terms of time intervals, 
then the equation for R becomes, 


xe a) 1 
if a = 


(7a) 


For continuous signals with no bandwidth limitation 
and therefore no time quantization due to sampling, A 
is zero, N is infinite, and the minimum observation in- 
terval for zero redundancy becomes 7,,=27;. For a 
bandwidth-limited system, however, it is interesting to 
note from (7a) that the minimum observation time to 
obtain a nonredundant set of data points is less than 
27T,, and has the form 


1 
( Fo.) stint — [(2 = =) y fai 


so that it would be equal to 7, if N were one. If the 
linear system were an amplifier with zero memory time, 
N would be one, since the single parameter would be the 
amplifier gain. In this case 7,,=At, the minimum sam- 
pling time required to observe one data point, and since 
T also equals At using the relation 7,=(NV-At) =At, the 
mininum 7;,=T7,. For a zero memory system, of 
course, 7’, would be zero ideally, as would also be the 
case for 7,,. The minimum bound of At is set for both 
I, and T;, by the assumed mechanism of forming each 
data sample by averaging over a single At interval. 


q 
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III. LeEAast-Squares EstTIMATION OF 
IMPULSE RESPONSE 


Levin’ has pointed out that a least-squares estimate 
of impulse response, based upon short operating records 
and the model of Fig. 1, follows essentially the same 
procedure as the statistical filter design procedure of 
Wiener’ and others. That is, one calculates as an esti- 
mate of g(r) that g(r) which minimizes E?, where 


ef [e — yokar 


b Ts 2 
-{ | f g(r)x(t — r)dr — v(0 | dt. 
a 0 


Here, 7’, is again the “settling time” of the system, and 
y(t) is assumed to be observed over the interval a to b. 
It will be assumed at present that a good estimate for 
IT’, may be made a priori. By applying standard varia- 
tional techniques,’ £(6) is found to satisfy 


(8) 


Ts 
f 2(8)ds2(7, 0)d0 = gzy(7), (9) 
where 
A b 
$:(7,0):= f x(t — r)a(t — O)dt (10) 
b 
bat) =f yxte — na (11) 
Ose 7, Ors. 957s Oat <b: 


The functions ¢,, and ¢,,, which might be termed 
“quasi-correlation” functions, bear a close resemblance 
to the usual statistical correlation functions. That is, if 
x is a continuous random function of time, its autocor- 
relation function may be defined as 


t = al i 
rx — 6 wey eS BG a(t — 6)dt. 
Pre(t — 9) a (¢— r)a(t — 8) 


To 2 mr hd 


Wrz gives the statistical properties of the random variable 
x and may be used to predict its future behavior. In our 
case, however, x is not a random variable and in fact is 
assumed to be completely unknown outside of the lim- 
ited interval of observation. Hence ¢., and ¢., are 


ZaNVICe le Levin, “Optimum estimation of impulse response in the 
presence of noise,” IRE TRANS. ON CIRCUIT THEORY, Violenl=/,, 
pp. 50-56; March, 1960. ; 

3N. Wiener, “Extrapolation, Interpolation, and Smoothing of 
Stationary Time Series,” John Wiley and Sons, Inc., New York, 
N. Y.; 1949. 
~ 4R. Courant, “Differential and Integral Calculus,” Nordemann 
Publishing Co., New York, N. Y., vol. 2; 1936. 
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not correlation functions at all, in the true statistical 
sense, and we have formulated the problem as a regres- 
ston problem rather than as one to which correlation 
theory is applicable.’ 

In sampled-data formulation, (9) becomes (with 
capital letters denoting matrices, small letters vectors, 
and* denoting the transpose of a matrix) 


P28 = Pays (12) 
or 
P =i 
& = D2, bay; (13) 
where 
Pez = X*X (14) 
ory = X*y, (15) 
and 
250) 30a 2 2 AAO eel) 
Be sh Bb 5) 
xX = X—2 X_3 ) (16) 
%—Gt=1) or wer 


M being the number of samples in the interval a to 3, 
and N the number of samples in an interval of duration 
T,. Hence, 


PLR DO (17) 


which reduces, for a “minimum” record of x(t), to 


cee, (18) 
the solution for the “nonredundant data” case. 

This procedure then gives a method for making use of 
redundant data in a systematic way. If the noise n(t) is 
white and Gaussian, the method is optimum in the sense 
that it gives a maximum-likelihood estimate of g, which 
is efficient. If the noise is Gaussian but not white, the 
least-squares technique does not yield an efficient esti- 
mate. The maximum-likelihood estimate in this case is 
the Markov estimate, which is efficient® but which re- 
quires much more computing capacity and makes use of 
the spectral information concerning the noise. 

It should be noted that although the estimation com- 
puter is required to multiply two MXN matrices, it 
need invert only an NX WN matrix, where WN is the num- 
ber of samples of the estimated impulse response. 


5A. M. Mood, “Introduction to the Theory of Statistics,” 
McGraw-Hill Book Co., Inc., New York, N. Y.; 1950. 

6 U. Grenander and M. Rosenblatt, “Statistical Analysis of Sta- 
tionary Time Series,” John Wiley and Sons, Inc., New York, N. Y., 
pp. 86-90; 1957. 
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IV. THE “SUFFICIENT TEST SIGNAL” PROBLEM 


The reliability of the estimate (17) will be seen to de- 
pend critically upon the nature (amplitude and wave- 
form) of the particular input x(¢) upon which the esti- 
mate is based. A logical choice for a measure of this reli- 
ability would seem to be the expectation of the inte- 
grated-squared-error between the actual and the esti- 
mated impulse responses. An expression for the ex- 
pected integrated-squared-error in the sampled-data 
formulation may be obtained as follows. 

The actual output vector is 

Na Perales (19) 
where x is the noise vector made up of samples of n(t). 
From (12), 


Hence, 
XX oe = 9,56: (20) 
Since 
X*X = Gy, 

we have 

Pz2(8 — g) = X*n, (21) 
or 

( — g) = Biz X*n. (22) 


The total squared error will then be the sum of the 
squares of the elements of é—g, or 


Tag = 8)" (8 8). (23) 


If the noise is white (introduces independent random 
fluctuations at each sample point) and has a variance 
o,°, then 


= PD Lr (24) 
i 


where a,; are the elements of the matrix 
Pie Nemes CX EX) LX, 


For a minimum record, this reduces to the matrix X-—. 
We may normalize (J?) with respect to the signal vari- 
ance go,” by defining a;;=0,a;;. Then 


(24a) 
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where 


2 
aij 
a,j 


may be interpreted as a “signal structure” factor. 

Hence, we might define a “sufficient” input signal as 
one for which some specified (J?) is not exceeded, as 
this expected error is seen to depend only upon the input 
signal and the noise variance. Whether or not this is the 
best possible sufficiency criterion remains a question. It 
would seem that to answer this question, one would have 
to consider, for example, the over-all control system of 
which the system estimator is a part, and choose a cri- 
terion based upon some optimum over-all behavior of 
the system. However, if one does not know exactly how 
the controller is going to “use” the impulse-response 
information (and different controllers might use it in 
different ways), then the expected integrated-squared- 
error criterion would seem to be a logical choice. 

The expected integrated-squared-error is seen to de- 
pend critically upon the determinant of ®,, (or X for 
the nonredundant record case). In particular, this de- 
terminant may vanish, yielding an infinite expected 
error. For example, if a nonredundant record is used, 
any linearly dependent. rows or columns in the determi- 
nant of X, which indicate “periodicities” (in a sense) 
in x, yield a vanishing determinant. With redundant 
data, however, some dependence may be tolerated. For 
example, if 


ftet9 
> an ke 
aan 


the first and third rows are linearly dependent, and yet 
the determinant of ®,,= X*X does not vanish. 

Hence, the nonredundant record is far more critical, 
so far as the determinant vanishing is concerned, than 
the longer redundant record. In fact, as the amount of 
redundancy increases, the determinant of ®,, becomes 
less and less critically dependent upon the particular x 
vector, as will be evident in Section V. It is noted that 
the determinant of ®,, may be small, due to either the 
“wave-shape” represented by x, or the elements of x 
themselves being small, which corresponds to the x(t) 
signal having insufficient amplitude. 

It is apparent that in a practical application, such as 
an adaptive control system, an expected-error computer 
could be included with the system estimation computer, 
as indicated in Fig. 3. The control computer would 
then receive information regarding not only the model 
parameters, but also the expected errors in the estimates 
of these parameters. The control routine might then 
base the computation of the control variable on both 
of these sets of,information. 
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Fig. 3—Parameter confidence computation. 


V. DEPENDENCE UPON RECORD LENGTH 
A. A “Sufficient Record Length” Criterion 


If the structure of the input signal itself or its statis- 
tics are known a priori, then it is possible to convert our 
“sufficient test signal” criterion into a “sufficient record 
length” criterion. For example, if the statistics of the 
input signal are known, we may determine the mean 
and variance of the expected integrated-squared-error 
as a function of the record length. That is, we may con- 
sider any particular input signal to be a member of the 
ensemble of signals of that particular record length, and 
average the expected integrated-squared-error over this 
ensemble. Hence, we are really doing two averagings of 
the error—one with respect to the ensemble of noise 
signals, and one with respect to the ensemble of input 
signals. This would therefore allow us to say with a cer- 
tain degree of assurance, that with a record of a cer- 
tain length we would have obtained a sufficient test sig- 
nal. This in turn might permit the omission of the error 
computer in Fig. 3. 


B. Examples of Record Length Dependence 


An example is presented (Table I, next page) where 
x is made up of independent samples of a random vari- 
able x(t) having a Gaussian amplitude distribution with 
variance one and mean zero. 

The expected integrated-squared-error per unit noise 
variance was calculated for 20 sample records, each of 
several different record lengths. The settling time 7, 
of the system was assumed to extend over 6 of the 
sampling intervals, which corresponds to 6 samples of 
the impulse response being obtained. Table I shows the 
expected error values obtained for redundancy factors 
of 0, 4, 1, 2, 4 and 8. 

In Figs. 4and 5, the mean and variance of the expected 
error are shown as a function of the redundancy factor. 
While the possibility of a “wild” result exists for a re- 
dundancy factor of 8, the probability of such an occur- 
rence is slight—whereas for the nonredundant case, one 
would definitely need to calculate the expected error for 
each individual x vector in order to determine whether 
or not that particular vector was a sufficient test signal. 

Hence it is clear that whether or not the error com- 
puter may be dispensed with depends very critically 


upon the available record length (which in turn depends 
upon the rate at which the system is time varying and 
the speed of data-reduction desired) and the allowable 
uncertainty in the estimate. 

In Table II and Figs. 4 and 5 are shown the corre- 
sponding results for an x signal made up of independent 
samples of amplitude +1, each occurring with proba- 
bility } in each sampling interval. This corresponds to 
samples of a “bang-bang” type of input signal, having 
random switching times, as indicated in Fig. 6. The 
various probabilities for the number of switches in the 
interval T, are given by the binomial distributions in- 
dicated in Fig. 6. 

It should be noted that the two signals (Gaussian 
amplitude and random switching) have identical auto- 
correlation functions and, hence, the same power density 
spectra (Fig. 6). 


VI. CONCLUSIONS 


Short records of the normal operating signals may be 
used to estimate in a least-squares sense the impulse 
response of a linear system, to within an expected inte- 
grated-squared-error which is a function only of the 
noise and the input signal. If such an identification com- 
puter were incorporated in an adaptive control system, 
it would be desirable to also compute the error to deter- 
mine whether or not the particular signal segment upor 
which the estimation was based was a “sufficient” test 
signal. A method of doing this has been developed. If 
the statistics of the input signal are known, this error 
computer may be eliminated for sufficiently long rec- 
ords, depending upon the confidence required in the 
estimate. For typical input signals, it is apparent that as 
the record length is increased, the expected integrated- 
squared-error decreases very rapidly—+.e., a large in- 
crease in precision is gained from a small amount of re- 
dundant data. For a time-varying system, this increase 
in precision must be balanced against the increase in 
error due to assuming the system to be time-invariant 
over the longer record, in a way which has yet to be 
studied in detail. 

For the same signal and noise variances (giving the 
same expected signal and noise energies over each meas- 
urement interval), the + switching signal provides a 
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SRA Era 


(os/on)2(12) VS RECORD LENGTH—GAUSSIAN AMPLITUDE SIGNAL, NV = 6 


Redundancy R = 0 1/2 1 2 4 8 
Mean (o3/on)?(I?) = 40.42 1.98 1.02 0.601 0.305 0.142 
Variance of (¢;/o,)?(I*) = 14,217.8 1.44 0.26 0.0413 0.008 0.00045 
Typical runs for (¢;/o»)?2(I?) 
1 4.935 0.958 0.595 0.625 0.212 0.147 
2 547.917 1.195 "1.249 0.917 0.266 0.132 
3 1.710 1.716 0.547 0.441 0.333 OnlSi 
4 3.144 DUES 1.051 0.498 0.244 0.161 
5 7.865 i) eS) 1.318 0.567 0.538 0.122 
6 1.687 2.693 0.961 0.491 (0) PIES) O27 
7 11.883 1.016 0.638 0.398 0.315 0.177 
8 3.636 2.568 Onset 1.063 0.249 0.123 
9 41.112 1.580 0.672 0.508 0.276 0.147 
10 7.280 2.388 0.772 0.457 0.214 0.187 
11 3.923 1.254 0.720 0.809 0.201 0.126 
12 6.855 1.953 1.234 0.724 0.267 0.164 
13 6.614 0.970 0.550 0.410 0.321 OF22 
14 SES 1.224 0.933 0.655 0.270 0.142 
15 119.832 1.891 2.293 0.374 0.247 0.173 
16 10.570 1.141 Ont 0.468 0.303 0.132 
1 127951 1.390 1.159 0.934 0.473 0.131 
18 2.190 6.397 0.191 0.472 0.470 0.161 
19 5.991 2583 0.912 0.829 02252 0.117 
20 S32 2.798 2 avai 0.384 0.362 0.113 
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Fig. 4—Expected error mean vs redundancy. 


VARIANCE 


-0001 


“00001 


Fig. 5—Expected error variance vs redundancy. 


GAUSSIAN AMPLITUDE SIGNAL —— 


4 6 8 
REDUNDANCY FACTOR - R 


RANDOM SWITCHING SIGNAL 


10 


1961 


Kerr and Surber: Impulse-Response Identification 181 
TABLE II 
(¢s/on)?(I?) vs REcoRD LENGTH—RANDOM SWITCHING SIGNAL, N = 6 
Redundancy R = 0 1/2 1 2 4 8 
Mean (os/on)?(I?) = 3.928 1.002 0.576 O.875 0.215 0.118 
Variance of (o;/on)?2([2) = 3.451 0.0729 0.00246 0.000216 0.0000171 0.00000117 
Typical runs for (os/o,)2(I?) 
if 5.000 0.828 0.586 0.379 (0) 0.120 
2 3.750 Lod 0.542 0.378 O23 0.117 
& 3.250 0.952 0.544 0.356 Oo PAIS) 0.118 
4 3.750 0.792 0.544 0.402 0.214 0.118 
S) 6.000 0.871 0.542 0.370 (Ds Buy 0.120 
6 3.750 0.828 0.546 0.380 0.214 0.119 
7 1.500 Leb 0.542 0.358 0.212 Oily 
8 2.500 It goyilal 0.612 0.364 O2ily Os a7 
9 6.000 0.792 0.542 0.387 0.210 0.120 
10 1.500 0.780 0.673 0.356 0.223 0.119 
11 4.500 0.828 0.542 0.420 O Zila 0.118 
12 2.500 0.875 0.647 0.370 0.217 0.118 
13 1.500 it Syl 0.542 0.387 0.210 0.118 
14 5.500 0.896 0.674 0.370 0.223 0.120 
15 4.500 0.792 0.542 0.356 OZ dat 0.119 
16 Se 190 TOU 0.612 0.380 Oily 0.118 
17 3.250 0.828 0.542 0.364 OR21S 0.117 
18 BY ADT] i) coli 0.561 0.374 0.216 0.119 
19 6.000 0.952 0.542 0.363 0.219 0.120 
20 3.750 0.792 0.542 0.383 0.210 0.118 
x(t) x(t) 
t t 
at 
bd 
(a) (b) 
-) 
p(x) 20 
os o C n=6 
(b) 3a 
sa 
(a) <3 
= +1 x ae jie? a SoA > ieee i 
P K)(a) 
(c) (d) 
(f) 
$ (7) Le 
ae } 
At +at a ae f 
Gr) = 1-I7) vat 2 
(-ats7<at) PiN=o aaa 
(e) (f) 


ig. 6—Input signal characteristics. (a) Gaussian amplitude signal. 
ee (b) Rondon Fae signal. (c) Amplitude densities of (a) and 
(b). (d) Probability P of K switches in the interval 7.. (e) Auto- 
correlation function of (a) and (b). (f) Power density spectrum 

of (a) and (b). - 
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considerably smaller mean value for the expected inte- 
grated-squared-error (J?) in the estimated impulse re- 
sponse than a signal having a Gaussian amplitude dis- 
tribution. It also results in a much smaller variance for 
(7*), and this variance falls off with increasing re- 
dundancy far more rapidly than for the Gaussian sig- 
nal. 


APPENDIX 
VARIATION OF SYSTEM BANDWIDTH 


The effect of increasing the assumed system band- 
width for a fixed measurement interval is to increase the 
expected integrated-squared-error in the impulse re- 
sponse, even though the degree of redundancy remains 
almost constant. This can be easily shown by using a 
very simple assumed structure for the input signal x(t) 
as follows: 

Let x(t) be a periodic square wave, jumping between 
+o, and —o, at 7, intervals, and thus having a period 
of 27,. Then it is easily shown from (24a) that for the 
nonredundant data case, the expected integrated- 
squared-error varies as 


ae 
Ga Ge = GN /2) 
so that (J?) increases directly with N, the number of 


parameters required to specify g(t) over the 7, interval. 
For the redundant data case, and for integer values of 


(25) 


| 


geet 
oye A ee 5 
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May 
R, it can also be shown that 
1 
= ( ) tore IN == jl 
[ (1?) Reon 
a Kobe N 1 
= — ) tore IN SD) 
2\R+1 
J nO oy tes (26) 


where 


r My. 
R= = | | = redundancy factor. 


For noninteger values of R, (24a) can easily be evalu- 
ated numerically, but expressing it in analytical form 
becomes cumbersome. The reason for the V=1 anomaly 
is outlined in Section II-C. The results of (26) are indi- 
cated in Fig. 7. 


Fig. 7.—Variation of (I?) with N for x(t) a square wave of period 27, 
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A Technique of Linear System Identification 
Using Correlating Filters* 


W. WAYNE LICHTENBERGERY}, MEMBER, IRE 


Summary—A technique for measuring the impulse response of 
linear processes while they are on line is described. Such an identifi- 
cation of process dynamics is necessary in process-adaptive control 
systems. A testing signal and correlating filter are employed after the 
manner of Turin. Such a procedure requires no multiplier, and the 
output of the filter is the impulse response as a continuous function of 
real time. To reduce accompanying output noise, the method of add- 
ing coherently the results of a number of tests made in succession is 
proposed. This idea is applied to the measurement of a member of an 
ensemble of slowly varying impulse responses. Optimum design of 
both the correlating filter and the necessary test signal is determined 
on the basis of minimum mean-square error of the resulting estimate. 
The optimization of the number of tests to be included in a measure- 
ment is described. The general results are applied to the case of a 
single, slowly time-varying process. In addition to optimum design, 
normalized curves showing the optimum number of tests for a par- 
ticular mode of variation are included. A second application is made 
to the problem of measuring a member of an ensemble of fixed proc- 
esses. The results of a digital computer simulation of this case are 
given. 


INTRODUCTION 


a process in a process-adaptive control system. The 

extent to which this problem can be solved often 
dictates the ultimate design of the entire control sys- 
tem. When the process is linear, the desired information 
often sought is the impulse response. Although the im- 
pulse response conveys more information than is needed 
in some applications, we shall seek it because of its com- 
pleteness and generality. 

This paper describes a method of determining the im- 
pulse response of a linear process while it is on line. The 
method consists of injecting a special test signal into the 
input along with the regular actuating signal and then 
passing the output through a special filter. While the 
method is not basically superior to conventional cor- 
relating methods, it does offer certain advantages and 
may be looked upon as a better alternative for some 
applications. 


1 is important to identify transfer characteristics of 
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script received, March 15, 1961. Taken in part from a thesis sub- 
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January, 1961. The research reported in this paper was supported 
jointly by the Dept. of the Army (Signal Corps and Ordnance 
Corps), Dept. of the Navy (Office of Naval Res.), and the Dept. of 
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under Signal Corps Contract DA-36-039-SC-85122 with the Coor- 
dinated Science Lab., University of Illinois. ; 
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THE USE oF STATISTICAL METHODS FOR 
IMPULSE RESPONSE DETERMINATION 


Well-established statistical methods [1] for deter- 
mining the characteristics of processes unfortunately 
require the process to be investigated to be time-invari- 
ant. In practice, of course, processes requiring complex 
adaptive control systems are time-variable. If one ap- 
plies techniques of conventional correlation to a situa- 
tion which is in fact nonstationary, the results are in- 
evitably in error. The magnitude of this error depends, 
however, on the rate of variation of the process pa- 
rameters. The results will contain negligible error for 
slowly varying processes. 

How slowly must a process vary in order to be con- 
sidered slowly varying? The system function for a time- 
variable process is defined as 


Ho ;)) = f 10, t)e-™ dy, (1) 


—o 


where h(X, t) is the response measured at time ¢ due to a 
unit impulse applied » seconds earlier. If we take the 
Fourier transform of H(jw, t), we obtain a bifrequency 
response function 


I (jw, Ih) = [ #Ge, thet dt, (2) 


wis the variable corresponding to the process variation, 
and w is the variable corresponding to the output varia- 
tion. We will assume that a process is slowly varying if 
the bandwidth in the w domain for all values of ¢ is ten 
times the bandwidth in the uw domain. That is to say, the 
impulse response decays to zero before the process 
parameters can vary significantly. 

A direct approach to correlation schemes is carried 
out as follows: If the output y(t) of a linear process (cf. 
Fig. 1) with impulse response /(A) is correlated with the 


0 [rar | 30 
Fig. 1—A linear process. 


input x(¢), the resulting cross-correlation is given by 


Raat) = f Searee = NaN (3) 


—0o 
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where 7 is the time delay in the correlator. Eq. (3) has 
no particular value unless R,,.(¢) has a special form. 
If x(t) is such that 


REA) ae Nod(t), (4) 


where 6(t) is the Dirac delta or unit impulse and No a 
constant, then 


Ryc(t) = [10x06 — Njdn (5) 


oO 


Winioks. 
Rial Noha (6) 


The assumption of (4) is too great to render the results 
of (6) practical. X(t) would have to have the spectral 
properties of white noise for this to be true. 

Often [2] a low-level test signal with a flat power 
density spectrum is injected into the input along with 
the actuating signal. The process output is then cor- 
related against this test signal. 

The usual realization of the correlator is a time delay, 
multiplier, and integrator. The ensemble average is re- 
placed with the time average under the assumption that 
all time series involved are ergodic. This is not strictly 
true with slowly-varying processes. Even if it were true, 
however, one would still have to average over-all time 
before the cross-correlation could be precisely deter- 
mined. Since such an average must be performed in real 
time, a compromise must be made. Reducing the inte- 
gration time permits the actuating signals (which for 
the purposes of identification must be regarded as noise) 
to appear at the correlator output. 

Some disadvantages of such a correlator are, thus: 
1) in order to make the output signal to noise ratio 
large, the integration time must be kept at some value 
T. The correlator can thus respond to changes in h(A) 
only after 7 seconds. 2) An ideal multiplier is required. 
3) The output of the correlator is the impulse response 
evaluated at only one value of time. For each value of 
time desired a separate correlator must be used. This 
could lead to a great multiplicity of equipment if the 
process were such that a large number of sample points 
were necessary to determine completely the impulse 
response. 


CORRELATION BY MEANS OF LINEAR FILTERS 


Let us now compare the input-output relation of a 
fixed linear filter given by 


yy = [ha — var, (7) 
with the expression for cross-correlation given by 
1 T /2 
R20) = lim =| h(r)x(\ + 1dr. (8) 
Too TJ _pj2 


An obvious difference in these equations is the 1/7 
factor of (8). This factor appears in the definition be- 
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cause the time-series treated up to now have been those 
of infinite energy but finite power. Such time-series are 
usually referred to [2] as being of infinite duration. If, 
however, (A) or x(t) is of finite duration,' then (8) must 
be redefined by 


Rus = il “nOyell + dad (0) 


—o 


in order to prevent &,,(t) from being trivially zero. 

Further comparison of (7) and (9) can be made con- 
veniently by considering their respective Fourier trans- 
forms, namely 


V(jw) = H(jw)X (jo) 


and 


Snz(jo) = H*(jw)X (jw), (10) 


where the capital letters denote the corresponding trans- 
forms; Sp2(jw) is the transform of R).(jw), and the 
asterisk denotes the complex conjugate. Eq. (10) shows 
that the output of a linear filter can be taken to be the 
cross-correlation of a function whose transform is the 
complex conjugate of the filter transfer function with 
the input function. Translating this statement into 
terminology of the time domain, the cross-correlation of 
two time functions (of finite duration) can be obtained 
by passing one of them through a linear filter whose im- 
pulse response is the time reverse of the other. The 
prospect of using this fact to accomplish the cross-cor- 
relation needed to determine impulse response is in- 
teresting. The use of an ideal multiplier is no longer 
necessary with this method, and the output of the filter 
is a continuous function of time. 

Fig. 2(a) shows a filter in use as a correlator. A test 
signal x(t) is passed into a process f(A) to be measured. 
The output is passed into the filter whose impulse re- 
sponse is x(—¢).* It is instructive to rearrange the 
blocks of Fig. 2(a) as shown in Fig. 2(b). Such an opera- 
tion is permissible because of linearity. In Fig. 2(b) we 
see that x(t) is first correlated with itself, and the re- 
sulting autocorrelation function is passed into the 
process undergoing measurement. The final output is 
thus the convolution of this autocorrelation function 
with the impulse response of the process. If the output 
is to be the impulse response of the process, it is clear 
that the autocorrelation function of the test signal 
must be an impulse. 

There are two major limitations on this idea. First, 
x(t) must have a flat spectrum of infinite bandwidth if 
R,2(t) is to be an impulse. Since this cannot be attained 


! More properly if 


fou or {oat 


is finite. 
2, We will not be concerned immediately with the condition of 


relizability, z.e., that the impulse response must be zero for negative 
time. We may introduce time delays to avoid this. 
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in a practical situation, R,,(¢) will have a nonzero width 
(roughly the inverse of the bandwidth), and the output 
will be distorted accordingly. Second, the measurements 
must be made in the presence of the normal actuating 
signals which for the purpose of measurement must be 
regarded as noise. For practical reasons the amplitude 
of the test signal must be small with respect to these 
signals so that the process output is not appreciably 
disturbed. We must rely upon the matching effect in the 
correlating filter to enhance the test signal to actuating 
signal power ratio.’ Let us now ask questions of a more 
quantitative nature. How much error is caused by this 
scheme? Is there a better filter design than the matched 
filter? What is the best form of test signal? 


Pi Filt 
soy Mp a |__ Mlle = 
Sh~ yit) WN 
(a) 
Filter Process 
a whl | xen oe ES PN We 
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Fig. 2—(a) Measurement of impulse response by means of a corre- 
lating filter. (b) Alternate arrangement of the blocks of Fig. 2(a) 
for illustrative purposes. 


OptimMuM DESIGN FOR SINGLE MEASUREMENTS 


The answers to these questions were supplied by 
Turin [4] in solving the problem illustrated in Fig. 3. A 
test signal x(t) is added to noise n;(t) and passed into a 
member /;(A) of an ensemble of processes. An “estimat- 
ing” filter is placed at the output of the process, and the 
output of this filter is compared to the impulse response 
of the process. Turin solved for the particular estimat- 
ing filter transfer function H,op¢(jw) and the particular 
test signal spectrum X.,:(jw) which minimized the ex- 
pected mean-square error of the estimating filter out- 
put. This solution was made with respect to the ensem- 
ble of noises 1;(t) and the ensemble of processes h;()). 
Two constraints placed upon the testing signal were 
that it have a constant energy and that it (and there- 
fore the estimating filter) be band-limited to band B,. 

Although Turin’s problem arose in the field of com- 
munications and radar, the applications to process 
identification for adaptive control are obvious. In our 
case the input “noise” is largely actuating signal. Of 
course any input to the process other than the test sig- 
nal is considered to be noise. In the most general case, 
we have not only actuating signal present but also 
other signals of undisclosed origin. Some of the latter 
might even originate within the process. We shall, how- 
ever, think of them as having been introduced at the in- 
put together with the actuating signal. All of these sig- 


3 Filters of the type described here are known as “matched” 
filters [3] and are used especially in radar and communications to 
minimize the peak SNR. 
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nals will be assumed to be mutually independent. Thus, 
their power spectra are additive to what we shall call 
the input noise power spectrum S,,(jw). 


A TECHNIQUE FOR REDUCTION OF OuTPUT NOISE 


In general, the “noise” power will be relatively 
greater than the test signal power. The output noise 
will accordingly be quite high. We, therefore, are con- 
fronted with the problem of increasing the energy of the 
test signal without increasing its average amplitude. 
This can be done only by increasing its duration. One 
way of increasing the effective duration of the test sig- 
nal is to add the results of several measurements at each 
instant of time. This is a standard technique [5] for im- 
proving the SNR. Of course, resorting to such a scheme 
will lengthen the determination of impulse response by 
perhaps many times. The problem, however, is funda- 
mental and also occurs in the standard techniques of 
correlation where it is necessary to increase the time 
constant of the integrators until the output SNR is 
tolerable. The coherent summation may be achieved in 
a variety of ways. A tapped delay line, a recirculating 
delay line, or other analog or digital equipment may be 
used for the purpose. In the following development the 
word “test” will be used to denote a single measurement 
like the measurement of Turin’s. A “measurement” will 
refer to the integrated results of several tests. In addi- 
tion processes undergoing measurement will be required 
to be fixed during a single test but will be allowed to 
vary from test to test. We thus have the following gen- 
eralization of the problem of Turin. 


Test signal 
x (t) 
® Process Estimating Estimate of 
hy 0d) Filter hj (A) 


Fig. 3—Turin’s identification problem. 
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nj(t) 
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| closed at 
uj (t-t) - Kt) ! tent. 


nj(t) 


Process 
hy (€) 


vij(t-t, —nt) 


y(t-t,-nto) 


Fig. 4—Extension of Turin’s problem to reduce the noise com- 
ponent in y(t—h —nto). 


A finite train of m test pulses is added to the normal 
input of a linear process (cf. Fig. 4). The output of the 
process during each test pulse is added to the sum of all 
previous tests in the measurement at each instant of 
time. This is accomplished by the use of a delay or stor- 
age element and an adder (not an integrator) as shown 
in Fig. 4. After the last test pulse, the result of the sum- 
mation, still a function of time, is passed into an estima- 
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tion filter h,(A). The expected mean-square error will be 
minimized by a choice of estimation filter, test signal, 
and the number of tests included in each summation. 


OPptTIMUM DESIGN FOR AN n- TEST MEASUREMENT 


The expected mean-square error is given by 


ele fi 
\7 


where 7 is the maximum permissible duration of the 
process impulse responses in the ensemble being meas- 
ured; f; is the time at which the measurement is 
started, tf) the duration of each trial, and the (( ~))i; 
signs denote averages over the ensembles of noises 1; 
and of processes h;. We minimize the error first by vary- 
ing the estimating filter. 

It is shown in Appendix I that for an arbitrary test- 
ing signal the optimum design of the estimation filter 
is given by 


gor (t, t1 + nto) — hilt, tr + nto) | “tt)), (11) 


H;H*);X* (jw 
H.(ju) = ( ) va 


(12) 


where for convenience 1;=H;(jw, ti+nto) is the trans- 
fer function of the sample process expressed also as a 
function of time; 


1 n=l 
= — D0 Ai(jo, tr + to) 


WN k=0 


a 


is the mean process transfer function over all the tests, 
X (jw) is the transform of the test signal, S,(jw) is the 
noise power spectral density, and fp is the time between 
the start of each test. While it appears that H/.(jw) is a 
function of the very process H;(jw) it is attempting to 
measure, /7,(jw) is actually a function only of the statis- 
tics of the ensemble of H;’s, given by various ensemble 
averages. For time invariant processes, 7.e., for 

H;(jw, t) = Hi(jw), (13) 
(12) reduces to 


X*(je) 


A (jo) = (14) 


oF 
| X (ju) |? + — SnCu) 


Except for the factor 1/m in the denominator, (14) is 
identical to Turin’s (5). 
The result of (12) is optimum for any test signal x(t). 
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Let us assume, then, that the estimation filter is now 
optimum and attempt to minimize further the mean- 
square error of (11) this time by choosing x(¢). We im- 
pose the constraints on x(t) that its transform X (jw) 
shall lie only in the band B,; and that x(t) shall have a 


fixed amount of average power W. Thus, we have 
X(jw) = 0, w not in By 


and 


iL io) 
—| | X (jw) |%dwo = W, (15) 
Weis, Uh es 
where f, is the duration of the test signal. 

It is shown in Appendix II that the optimum test sig- 
nal is given by 


| (HA), |? 1/2 
Gt!4( jo, t1, 2, to) Sni!/4(jw) {|-Fa_| 
VW 
X (jo) = E Ord bak hed 
a > G1? (jw, hi, nN, to) Sn(jw) BALLS (16) 
nN 
(63) in Bo 
0. oun Be 
where 
Casing neh SEHes (17) 
JU, F1, Mh, LO} — — 
r (| H;|*); 
and 
sect [ OH) |2(| He |?)s]¥/2S,1/2(jo) 
— w 
~~ 2a a Hy )s 
Vx = _ | Fs!) (18) 


‘Gs 
NW te + —{ G(ju, t1, , to) Sn (Ja) dw 
dr J By 


B(w) is an arbitrary phase function to be elaborated on 
later, and By is the sub-band of B,; where the term in 
braces in (16) is real. 

The meaning of the first factor G'/4(jw, t1, 2, to). S,1/4(jw) 
of (16) is that if the noise power at a given frequency is 
small, then little signal energy is needed at that fre- 
quency in order to determine /,(A). On the other hand, 
the second factor (in the braces) states that if the noise 
power at a given frequency is large or if the average 
process power transmission is small, it is a waste of the 
finite amount of power available to put much, if any, at 
that frequency. 

If (16) is substituted into (12), we have the expression 
for that particular estimation filter which will minimize 
the mean-square error, given 7 tests. We have 


1/2 


i [?):GU4(jww) S,4(jo) i! ( 


2) |t/2 


eee 
Als 


@ in Bo. 
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ete), w in By 


-| ee F G1)S,4!(je) 
a (19) 
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By substituting the expressions for optimum estimat- 
ing filter and optimum testing signal, given by (19) and 
(16), into (11), the mean-square error, we obtain 


1 
= Saas Hi; 2 id 
€ — aif! ) dw 
1 | (H.*H,); |? 
Sars °F et mee ors Bae 
bar a (| F.)%); ( i de 
1 [| (2*H.);|2(| Hi |2)s]!” ih 
-- St? (Gw)d 
is iE (| Bi: |?); Bes 
+ ee (20) 
ee 
nW te + = Sn(jw)dw 
as By (| A; »s 


The first term of (20) is error of omission, arising from 
the lack of test signal components in certain regions of 
the pass band of h;(A). The presence of the second term 
of (20) may be attributed to the time-varying nature of 
the ensemble averages. If the processes are assumed to 
be fixed or if a single process is dealt with so that the 
ensemble averages are not necessary, this term drops 
out. The third term of (20) represents the components 
of error caused by the noise and the distortion of /;()) 
which occurs unavoidably when the noise is reduced. In 
addition, some time variation terms are included. 

The phase function B(w) appearing in (16) and (19) 
was left unspecified mainly since its choice did not 
directly affect the expression for minimum mean-square 
error given by (20). However, it is wrong to conclude 
that any choice of B(w) is equally as good as another. It 
is, of course, the combination of the amplitude and phase 
spectra which determines the function in the time do- 
main. Thus, in any situation where constraints are 
placed on the maximum amplitude (more properly, the 
peak power) of a function, the class of admissible phase 
functions is somewhat restricted. 

Consider, for example, a signal having a flat ampli- 
tude spectrum over some band and a phase function 
which is linear with frequency. The inverse transform 
or time domain equivalent of such a signal is a narrow 
pulse, the shape of which depends on the way in which 
the amplitude spectrum cuts off at the edge of the 
band. If the peak power of such a pulse is limited, then 
so is the total energy in the pulse. It is helpful to look at 
the so-called “group delay,” or —d8/dw. For the case 
of linear phase, B(w) = —tow. Thus, —d8/dw=t) and, 
hence, all components of energy are delayed by the same 
time, emerging together to give an energetic pulse. 
We need a group delay which allows a steady amount of 
energy to emerge per unit time. Fig. 5 presents the ele- 
ments of this argument. In Fig. 6 is shown a more de- 
sirable group delay (assuming a constant energy den- 
sity). It leads, of course, to a quadratic phase function 
which is the basis of the well-known linearly FM signal 
of modern high-resolution radars [7]. 
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Fig. 5—Illustration of pulse dispersion with two types of phase char- 
acteristics in a network whose amplitude response is flat over a 
wide band. (a) Linearly decreasing phase. (b) Corresponding 
group delay. (c) Resulting impulse response. (d) Nonlinearly 
decreasing phase. (e) Corresponding group delay. (f) Resulting 
impulse response (not to same scale as above). 


y(t) _dB 
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Fig. 6—Example of a desirable phase function. (a) A desirable 
impulse response. (b) The necessary group delay. (c) The re- 
quired phase characteristic. 


In fact the requirements on our phase functions and 
those found in the field of matched-filter radars are 
quite similar. We have a peak-power limited signal into 
which we are trying to crowd as much energy as possi- 
ble. We do this not by increasing the amplitude but by 
increasing the duration of the pulse without changing its 
bandwidth. All this is accomplished by a judicious 
choice of the phase function. The interested reader is re- 
ferred to the vast body of literature on the subject of 
matched-filter radars and related topics to which only a 
few references can be included [3 |. 

Finally, turning our attention to (20), the expression 
for minimum mean-square error, we see that the error is 
yet a function of , to, and t, which may yet be varied 
in order to effect a further reduction of mean-square 
error. Of these, to and ¢, cannot be chosen independently. 


They are related by 


1.e., the duration between the start of successive trials is 
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given by the sum of the maximum expected impulse re- 
sponse time and the duration of the test signal. 

Thus, we are left only with the number of trials 7 and 
the time duration ¢) of each trial with which to work. 
The duration of a measurement—time required to sum 
the results of the  tests—is given by nto, the product of 
these variables. Further improvements in the measure- 
ment will come by optimizing this product. Such an 
optimization is a straightforward problem in the cal- 
culus. 


EXAMPLES 


Eqs. (16), (19), and (20) are complicated in appear- 
ance mainly because of their general application. Sim- 
plifications result when they are applied to specific prob- 
lems. Of the general, slowly time-varying ensembles 
which we have considered, there are some interesting 
special cases. One such case is that of an ensemble of 
fixed processes (such as that of Turin) where the maxi- 
mum number of trials permitted in the measurement 
scheme is determined by considerations other than 
minimum mean-square error. Another such case is that 
of a single, known impulse response which is slowly 
changing in time. The identification process must follow 
the course of the changes. It is this case which we shall 
first consider. 

Suppose we have a single, known process which var- 
ies slowly with time. It is desired to follow the course of 


these variations so that the current state of the process. 


will always be known. Under such conditions, the en- 
semble averages disappear from the previous equations, 
and the cancellations which can be made from the re- 
sulting equations reduce them into the forms given 
below. For the optimum estimation filter with arbitrary 
test signal, we have 


HH*X* (jo) 


H(jo) =" (22) 


i RATE Oras 
| A |?| XGe) |? + — | A [ASn(Ge) 
Before (22) can be reduced further we must assume a 
form of time variation of h(A, t:). For this example, we 
will assume that the impulse response A(X, t1) of the 


process is separable into a fixed part h;(A) and a linearly 
time-varying gain a@+aty; 1.e., let 


ha, t1) == (do + aty)h;(A). 
In the frequency domain we have 
A (jw, t1) = (ao + ati) Hy (jo). 


Substituting this into (22), we obtain 
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Thus, we have a case similar to that of (14) but with 
time-variable gains on each term. 

Upon dropping the ensemble averages and simplify- 
ing, (16), the optimum test signal, becomes 


1 
G44Gjo)Sn4(jo) | —= | H(jo, tr + nt 
(joo) Sn!/4(je) Ee | H(jo, ts + nto) | 


X (jw) = - jk 12 


— = GG) S.4Ga) |, (24) 
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win Bs 


0, win By 
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Gees 
| Z|? 
1 ; 
ea [G(jw) | AH (ja, ti + nto) |2Sn (jor) }1/2deo 
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and By is defined as that range of W where 
il 


e 
| H(jo, ti + nto) | — —G'?(jo)S,1/2(ja) > 0. 
4/nr n 


For our example, G(jw) becomes 


1 n 
— > [ao + a(t, + kto) |? 


Wk 


=i 
A 
1 oa 2 
|— 3 ay + ally + a) | 
k=0 


nN 


G(jw) = 


2n—1)(n—1 
ao? + (m — 1)aoaty + o ne ) ato? 
= “ (25)\4 
(n — 1)? (25) 
ao? + (m — 1)aoaty + heicoe ato” 


Divide both numerator and denominator of (25) by 
ao” and let 
ato 


T=>—: 
ag 


T is proportional both to the normalized slope of the 
amplitude function and the time duration of a single 
trial. It is, thus, a measure of the amount of variation 


1 nt 
[ao + a(ty + nto) | E > ao + a(ty 4 a | X* (jw) 


H (jw) = 


eet 2 Tr. wl 
E Senex es) Baer ee |— Stee eere au) ee 
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which occurs during one trial. We have, then, in terms 
of + 


G = G(n,7) 
2n— l)n—1 
Ge Ore _S I Be 
6 fae) 
= . (26) 
(n — 1)? n> 2 
1+ (n—1)r+ ee T 


Applying similar simplifications to the expression for 
mean-square error, (20) becomes 


1 
e=—— |_| A(jo, ti + nto) |2do 

2aT J 2, 
1 a tak 

(ao + anto)?G(n, T) If | H,;(jw) Sua) | 
“7 / Bo 

2p ; . (27) 
nWtz + TG(n, 7) —| Sn (jw)dw 
Qa By 


We will assume that | H( jw, trt-nto) |? is sufficiently 
small in the region of By such that the first term of (27) 
may be disregarded. We will be concerned with the sec- 
ond term e¢, which contains the contributions of the 
noise and smear components of the error. 

Notice that 


i . \ 
=f S,(Jw)dw 
2rd By 


is the noise energy N per trial and that 


1 : 2 
bs | Hy(je) | Sy!) da | 
2r J B, 


is related to the output noise power. Call this expression 
P,,. Making these substitutions and dividing numerator 
and denominator by NG, we have 


pie (1 + nr)? 


N t+ nN (=) 
G ] 


where G(n, 7) is given by (26). We see that e, is a func- 
tion of n,7, and Wt,/N. Wt,/N will be recognized as the 
input test signal to noise (actuating signal) energy ratio. 

A minimization program was prepared for Illiac, the 
University of Illinois digital computer. The function 
minimized was the normalized version of (28), namely, 


£ (1 + nr)? (29) 


1 (=) 1 

nN —> 
by NG 
Plots of ey vs » with 7 as a parameter are presented in 
Figs. 7-10 (next page) for four values of Wi,/N. It is 
apparent from the figures that for a given value of 


Wt,/N, as 7 decreases (hence the rate of variation), we 
may integrate more trials before the point of diminishing 


(28) 


= y : Pari 
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return is reached. Hence, the minimum ey is smaller for 
each value of r. Further, as Wt,/N increases we may 
tolerate, in general, greater values of r. This is intuitively 
obvious. The quantitative information conveyed by the 
figures is made more interesting if we note that the 
point ey=1 is that error which would be given by 
Turin’s filter. Thus, we may do either better or worse 
than Turin, depending on the normalized rate of varia- 
tion of the process and the input test to actuating signal 
power ratio. 

Another case of special interest is the measurement of 
one of an ensemble of fixed processes where the number 
of trials is limited by external reasons. Such a limita- 
tion might be iniposed in order to effect a compromise 
between a low value of mean-square error and having the 
information available as soon as possible. For this case, 
(12) becomes 


X* (je) 


H (jw) = (30) 


* 5 ie as 
| X Go) [2 + ~~ Sn (fe) 


as has already been shown. 
For the optimum test signal, (16) becomes 
(| Hi(je) 
/nd 


2) 1/2 


S.3(je) | 


; a 1/2 
X opt(Jw) Bas we SG) | E18) | (31) 
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since G(jw) =1 for all fixed processes. Also, we have 


ela [«| H,(jw) 2) Sn (jo) ]!2des 


Jnr = fe 
nWle+ >| Saljie)de 


Td By 


for this case. Thus, when the optimum test signal is 
used, 


Vid Sn" 4(Gea) E Ha(jes) |? 
(| H(jo) |?)s1? / nr 


: 3 1/2 
Hen( Jo) = a rt S.t) | et iB) | (32) 
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It should be noted that if the input noise is white and 
if there is no a priort knowledge of the statistics of the 
ensemble, then both S,(jw) and (| Hil jo) | 2); are con- 
stants, and H,, (jw) is proportional to X*(jw). Thus, 
the optimum estimator is a matched filter. Furthermore, 
as shown by (31), the test signal has a flat amplitude 
spectrum with an arbitrary phase function. This agrees 


with the intuitive ideas expressed earlier. 
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Fig. 7—Normalized error vs number of tests included in one meas- 
urement for 19 values of r. Test signal to actuating signal energy 
ratio is 10.0, 


Fig. 9—Normalized error vs number of tests included in one meas- 
urement for 18 values of r. Test signal to actuating signal energy 


ratio is 0.1. 
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Fig. 8—Normalized error vs number of tests included in one meas- Fig. 10—Normalized error vs number of tests included in one meas- 
urement for 17 values of 7. Test signal to actuating signal energy 
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There are other circumstances under which (30) leads 
to a matched filter. If 


EF 
| X (jo) |? > — S,(ju), 
VW 
then 


H.(jw) = 


: 33 
X (jw) Se 
Although (33) is the expression for an inverse filter, we 
are free to choose amy test signal since the resulting error 
is zero. Thus, there is no uniquely optimum test signal. 
Obviously such a test signal should include compo- 
nents at all frequencies over the pass band of H,(jw). If 
this were not so, the inverse filter would have to have 
infinite transfer characteristics at all frequencies where 
the testing signal has no components. In fact, it is easy 
to see that a testing signal with a flat amplitude spec- 
trum over the pass band of the process would be desir- 
able to use since the corresponding inverse filter would 
be an all-pass network with the negative phase func- 
tion. Notice, however, that for the case of an all-pass 
function and only for this case, the inverse function and 
the conjugate function are proportional. Thus, if we 
choose a test signal with a flat amplitude spectrum, we 
again have a matched filter for the optimum estimator. 
Finally, when (T/n) Sn(jw) >| X (jw) |? we have 


aoa 
eee 
T Si(jw) 


(34) 


If the input signal is white over the pass band of the proc- 
ess, then H,(jw) is matched to X(jw) regardless of its 
form. 

In summary, for all possible input SNR if the input 
noise is white over the pass band of the process and if no 
statistical knowledge of the ensemble of process is avail- 
able a priori, then a test signal with a flat amplitude 
spectrum (over the pass band of the process) and its cor- 
responding matched filter are optimum in a minimum 
mean-square sense. 

The above results were applied in a simulation on II- 
liac to a process in the presence of actuating signals. The 
matched filter used in the simulation is described in 

‘Fig. 11. Both pole-zero plots and the impulse response 
are given. Theoretically [8] an infinitely long linear ar- 
ray of all-pass quadrupoles has for its impulse response 
a pure time delay. This is because its amplitude spec- 
trum is flat and its phase spectrum is a linear function 
of frequency. By leaving out some of the quadrupoles, 
this linear behavior of the phase is disturbed so that the 
derivative of the phase function—the so-called “group 
delay”—is no longer a constant but is now a function of 
frequency. The impulse response is therefore no longer 
pure delay. A judicious choice of the pole-zero locations 
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Fig. 11—(a) Pole-zero plot of a matched filter used as correlator in 
simulations. (b) Impulse response of the above filter. The time 
reverse of this function is the test signal. 


enables the energy to be distributed more evenly in 
time. The Butterworth filter used in conjunction with 
the linear array helps to prevent a burst of energy at 
t=0. 

Results of the simulation for two cases are shown in 
Figs. 12 and 13. In Fig. 12 no actuating signal is pres- 
ent. This is the ideal situation from the standpoint of 
measurement. In the figure, (a) is the input to the proc- 
ess. This input consists of the test signal only for this 
case. (b) is the resulting output of the process. The proc- 
ess for the example was second-order with a damping 
factor of 0.6. (c) is the output of the matched filter. Note 
the time delay which is necessary because of realizabil- 
ity. (d) is the impulse response to be determined. This 
is included for purposes of comparison. (e) is an ex- 
panded version of the interesting portion of (c), show- 
ing the resulting estimate of the process impulse re- 
sponse. 
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Fig. 12—Normalized results of a simulation of the measurement system in the absence of actuating signals. (a) Process input (test signal 
only for this case). (b) Process output and input to the correlating filter. (c) Correlating filter output. (d) Actual process impulse response. 


(e) Expanded version of (c). Measured impulse response. 
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(a) (b) (c) (d) 


Fig. 14—Results of some tests included in a single measurement. 
(c) and (d) give the filter output for each test. This is only for 
convenience. Actually the signals of (b) could be added together 
before introduction to the filter. (a) Process inputs. (b) Process 
outputs. (c) Filter outputs. (d) Estimated impulse responses. 


Fig. 13 gives the results of a similar test, this time 
with actuating signal present. This actuating signal is 
a random signal with a power spectrum which is flat 
over the pass band of the process. It was obtained by 
smoothing a table of random numbers. For this case the 
test signal to actuating signal energy ratio was 0.73. 
Notice the resulting disturbance to the estimate (e). 

In Fig. 14, are given the results of some of the indi- 
vidual tests made. The test signal to actuating signal 
energy ratio was 0.1 for these tests. The samples were 
chosen to illustrate the diversity of the individual esti- 
mates. There is actually a coherent component present 
in each estimate which agrees with Fig. 12(e). The re- 
sults of the first 25 runs were summed. This improved 
the effective test signal to actuating signal ratio to 0.5. 
The result of the summation is displayed in Fig. 15. The 
error present could have been reduced further, of course, 
by summing the results of more tests at the expense of 
time. Further, the process would have had to remain 
fixed for such an additional duration. 
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Fig. 15—Correlating filter output when the input is the integrated 
result of 25 successive tests. The effective improvement of test 
signal to actuating signal energy ratio is a factor of five. 


CONCLUSIONS 


In the determination of impulse response of on-line 
linear processes, correlating filters may in many cases 
prove useful. Their use becomes advantageous when a 
large number of sample points of the impulse response is 
desired, since the output of such filters is a continuous 
function of time. In these cases, the amount of equip- 
ment required may be less than that necessary for other 
correlation schemes. Other advantages of the filters are 
that time delays and multipliers are not required. 

As with any short computation-time procedure, a 
single measurement will exhibit a large variance. This 
variance can be reduced by summing the results coher- 
ently with an accompanying expenditure of time and 
equipment. This is unfortunate because one would like 
to have the results available as soon as possible from the 
point of view of control system performance and because 
even for slowly varying processes, error builds up seri- 
ously for sufficiently long measurements. This is not 
basically different, however, from conventional corre- 


_lation methods. Only the parameters of a particular 


situation may determine in general which procedure is 
more useful. 

The most serious problem with correlating filters is 
the determination of a signal imbedded in noise. Much is 
known about this subject, and many of the techniques 
can be applied to this situation. Only the coherent inte- 
gration approach has been discussed in this paper. Un- 
doubtedly, however, there exist better approaches in 
given situations and perhaps in general. 


APPENDIX [| 


Consider a finite train of test signals x(t—t:—kto) be- 
ing fed into a member of an ensemble of slowly varying 
linear processes h,(£, t) along with the actuating signal 
n,(t) (cf. Fig. 4). For simplicity let us translate the 
time axis so that we will actually consider the input 
x(t)+n;(t+titkto). ti is the time the measurement is 
started, and fo is the time between the start of each test. 
Define nj42.(¢) =nj(t+titkto). The output of the proc- 
ess is then given by 


wij (t, ty + Rto) 


i nit kdlet= BY wae ole 1s 
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These w;; are fed into the summing device, and after all 
n of the tests has been made, i.e., after mfp seconds the 
summer gives for its output, 


n=l 


1 
= — Ds uij(t, ty + to). 


nN k=0 


vi;(t, ty a nto) (36) 
The output of the summer is passed into an estimation 
filter h.(\), whose output is in turn given by 


ie) 


yas(t, t1 + nto) = if h.(A)vis(t — A, tr + (n — 1)to)dd. (37) 


—o 
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x(t), what choice of h.(X) will minimize e of (39)? We 
proceed by methods of the variational calculus. We 
have 


GL 


— Ay(t, tr + nto) |dy4;(t, 6. + ntdt)) ='(), (40) 


[yas(t, tr + nto) 


where the notation de stands for “the variation of €.” 
Substituting (38) into (40) we get 


O= Ol. {— 2 Ss aie her) hil&, tr + to) bhe(u)hi(v, tr + Ito)[a(t — ¥ — |al(t — pw — v) 


+ a«(t-—-A— 


= h(t, ty + nto) ——— 


Substituting (35) and (36) into (37) we have 


yij(t, tr + nto) = — -> ff" he(A)Ai(E, tr + Ro) 


nN k=0 


[x(t —  — &) + nyn(t — A — &)]dédd. (38) 


E)nyilt —w—v) +a — pw —v)npar(t-—A—L + ny(t -—A— 


z De fle She(u)hy(v, tr + Uto) [x(t — w — v) + npilt — pw — v) Javan} ity) 


E)njzu(t — w — v) |dEdddvdu 


(41) 


Assuming the noise term is a member of a stationary 
random process with zero mean, we may perform the 
indicated ensemble average over the ensemble of noises 
n;. This gives 


1 Sis 1 
= AG > = parle lales 6h c(t) Ne (A)hi (E, ty + Rto)h; (y, ty + Ito) a(t —-rA- E)a(t a UR v) dvdéd\du 


25 
tae 
tee 


nN j=0 


SS ys ff scone ty + Ito) Ai(t, ty + nto)x(t — w — Pdvint it) ) 


From (11) the average mean-square error € is given by 


é= (= fbn tit-nto) —hilt, itn) Pat) (39) 


The problem is: given an arbitrary number 1 of trials, 
the statistics of the noise 2;, and an arbitrary test signal 


ei 


- n—1 n— 


ee 


a n—-1 


Dal if { fis AOE Cee EAY RAE Be pl iva ead 


(42) 


where R,,,(t) is the autocorrelation function of the noise. 
We interchange the order of integration, and extend the 
limits of integration with respect to ¢ if we recognize 
that /;(t) is zero outside the range 0<t<T and if we 
assume that the width of the central pulse of the auto- 
correlation function of x(t) is small compared to 7. We 
thus have to a good approximation 


6h e(L) — ye Sf ff sone, ti + Rio) Ailv, ty + oat — A — xt—p— v)dtdvdédy 


acer — <> fff he(ryhilE, ti + Rlo)hilv, ti + lo) Rnn(& + & — w — v)dvdédn 


nm nN k=0 


1 n=l 


>> if iE le tr + Uo)hilt, tr + nto)x(t — w — yd) di. 


nN i=0 


(43) 
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We may avoid great complication by ignoring the re- 
quirement of physical realizability for h(t), z.e., that 


Wein" Onta<o Os 


Thus, we may say that 6/.(u) is arbitrary for all values 
of uw. Eq. (43) cannot, therefore, be satisfied unless the 
bracketed term is zero. Equating this term to zero and 


taking the Fourier transform of the result, we have 


il n—1 n—1 
0= (EY Hj) HiGio, t+ bt) 
k=0 


=0 /=0 


-H# (jo, ti + Ute) | X (jw) |? 


n= 


hei 
2s — > H(jw) | Hijo, ts + bio) [2Sn(joo) 


TT VIET = 


Vicenll 


— — 0 A * (ju, ty + Rto) H(jo, ti + nto) X*(jo));. 


NM k=0 


(44) 


Simplifying, taking ensemble averages of individual 
terms, and solving the result for H,(jw), we obtain 
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APPENDIX II 


Eq. (45) gives the transfer function for the optimum 
estimation filter for an arbitrary number of trials when 
an arbitrary test signal is used. We shall assume now 
that such an optimum filter is used. The problem will 
be to further minimize the average mean-square error 
by choosing this time the optimum testing signal. The 
number of measurements will still be arbitrary. 

Two constraints on x(t) are that it shall be band- 
limited to band B, and that it shall have constant aver- 
age power. Thus, we have 


X(jw) = 0 for w not in B, (46) 
and 
——= | | XGw) do = W, 
2a x By 
where ¢, is the duration of x(t). (47) 


Before we may minimize e by varying x(t), we must 
obtain an expression for it when /,(A) is used. Squaring 
(39), we have 


e= ( =f yis2(t, f1 + nto) — 2yaj(t, t1 nto) hilt, 1 + nto) 


+ h;(t, ty + nt)|dt)) (48) 


n—1 


i 
(Hl ty + nto) — ys A*( ja, ti + i) X*( jw) 


nN k=0 


Hea) = 


© Hsia ti + Bto) s ; 


nN k= 


he 


(45) 
ee SO a8 | A; (jw, ti + Rto) *) Sali) 


nN k=0 


We substitute into this (38) to get 


vt ISS 
=(Cf |= Abe PUEDE ROLY Gods TAT CEE ete a 


+ x(t — A — E)mj4i(t — w— v) + w(t — pw — ») Mjye(t — dX — E) + melt — dX — E)mailt — w — v)|dvdtdrdu 


n—1 


nN 1=0 


1 -) 
=2—)>> ict he(u)hi(v, tr + Uto) hilt, tr + nto) [a(t — w — v) + nyyilt — w — v) |dvdy + A2(t, ty + nig} ity) ._ (49) 


Eq. (45) is the solution of the problem. 

It is unfortunate that physical realizability cannot be 
easily included in the work leading to (45). The equation 
itself is the counterpart of the solution of Wiener’s opti- 
mum prediction and filtering problem for the unrealiz- 
able case. 


We now take the ensemble average over the ensemble of 
noises ”;, rearrange slightly, interchange the order of 
integration on some terms, and apply the same ap- 
proximations regarding the extension of the limits of 
integration on the variable ¢ as in Appendix I. This 
gives us 
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n—Vine—l 


1 os 
€= es L e(u) < — 5S SANA Ae(r)AilE, tr + Rto)hilv, tr + Uto)x(t — A — Balt — wp — v) dtdvdédy 


We 10 
TN haces 
HEP Pf Herne + tei + tt Ryd +E w= addr 
Z k=0 
1 cl ie) . 
—— il Ai(v, ti + Uto)Ai(t, tr + nto)x(t — w — v)dtdv ) du 
nN it=0 —o We 
+= fi h(t, ty + nto)dt + — -{{f{-- = 5y he(u)hi(v, tr + Uo) Ac(t, tr + nto)a(t — pw — Paras : (50) 
—o —o WM 1=0 i 


Notice that the term in brackets in the first integral of 
(50) is identical to the bracketed term of (43) which is 
known to be zero. Taking ensemble averages of the sepa- 
rate terms of the remaining part of (50) and taking the 
Fourier transform of the result we thus have 


» -F DS iljo, t1 + blo) H* (ju, tr + nto) ) X HA je)X(ja) dw. (51) 


k=0 t 


1 
-sf MC) Haldia + mt 


Substituting (45) for H.(jw) we have the resulting ex- 
pression for error 


1 
2 een By MG, ty + nto) |?); 


(— = Hj(jw, ti + to) Hi* (jw, tr + i 
\n k=0 We (52) 


2 4p it 
) | xa) [+= | Hadj t+ He) |) 5.G50) 
ie nm \N k=0 i 


1 
(|= Hj t+ kto) 
nN 


To simplify the writing of these equations, we will use 
the notation 
a Ses pS 
Hijo) = — >) Hijo, ti + hto). 


WN k=0 


Eq. (52) is the expression which must be minimized by 
a choice of X(jw) subject to constraints (46) and (47) 


Thus, we have 
1 i wey, 
aE ao (— f | X(jw) |2dw — wi.) = () (53) 

2rd B, 


where ) is a parameter. Doing the operations indicated 
above, we have 


F | GEG) HA Cents + mte))s| (EG) PY So je) 8 | XG) |? ! 
fy punee to +5 [ 5| X(jw) |2do, (54) 


ime | re be 
aT feo = (Go) Sue) | 
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and by factoring we have 


ie Aa eee Ses Oe 
7 | (Hi(jo) H* (jo, tr + nto)): |?(| Hi(jo) |?) Sn (jo) 
2 = ff 2 E i X (jo) |2de. (55) 


eee ee ee Ts a5 ae 
| FEGa) |*)s| Xe)? +— (| H.CFe) P) Sele) | | 


The limits of integration of (55) hold by virtue of con- 
straint—(46). Eq. (55) cannot hold unless the term in 
braces is zero, since 5| X (jw) | 2 is an arbitrary function. 
Setting this term to zero and solving the resulting equa- 
tion for | X(jw)|? as a function of \ we have 


| (Hs(jeo) H* (jee, ty + mto)) |? 
ur | (jw) |?): 


1/2 Ip 
| Xa) |2 = GHC je)5,3!9( je) ( ) -— Gu) 8G) |, Rie: 


=0, win Bo. (56) 


G(jw) is defined as 


are 
ats) — LEGA Be 
(| Hi(je) |): 
Bz is that sub-band of B; where | X (jw) | 2>0. This must 
be true since | X (joo) |? is an energy spectrum. Thus, in- 
stead of the optimum test signal we must work with the 
realizable part of the optimum test signal. Bs is of 


course the remainder of the frequency spectrum. 
From (47) and (56), we obtain a solution for \. Thus, 


(iGo) He (jo, ty+ nt); /\U® 1 a as & 
REE : an iol ga iets Caen lee (57) 


1 
Wt, = —| G42( jo) S,1/2(jw) ( ss 
S (| A ,(jw) 2). VAL 2a B, 


2a 


from which we get 


- 
eal G1!( joo)Sn'!( joo) | Hi(e) Hi*(jo, tr + nto) | ((| HiGe) |2),)-¥2deo 
7 J By 


Vi = 7 i (58) 
nWig ol — G(ja)Sn(jw)dw 
2rJ By 
Finally, we have for the optimum test signal 
| Hijo) H*(Gjo, tr + nto) |\2 1 
X (jw) = G"4( ja) S,1/4(jw) I( ) Bret aloe — 78 (w) : 
( nn | H,(je) |); . (jw) (jw) é » win By, 
= 0, w in Bo, (59) 


where B(w) is an arbitrary phase function. 
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A Modified Lyapunov Method for 
Nonlinear Stability Analysis” 


D. R. INGWERSONY, MEMBER, IRE 


Summary—A modification of the original Lyapunov stability 
criterion is given, which includes intermediate conditions of stabil- 
ity, as well as “stability in the small” and “stability in the large.” A 
means is developed for applying it to practical control problems that 
eliminates much of the guesswork usually required with Lyapunov 
methods of investigation. The process is based upon an integration 
of matrices which solves the linearized problem exactly. It gives suffi- 
cient conditions for the stability of nonlinear systems that are always 
correct for small disturbances and may be exact or conservative for 
large deviations from equilibrium. The formal procedure admits to 
enough variation that a wide range of nonlinear problems can be 
treated. Examples from both continuous and discontinuous feedback 
systems are given to illustrate its use. 


INTRODUCTION 


linear stability analysis have caused investigators 

of automatic control problems to divert their atten- 
tion from the various transform methods to some of the 
more fundamental ways of treating dynamic systems. 
Most of the well-known procedures of dynamics have 
been of little use because they were devised for a differ- 
ent kind of problem. One classical means of analysis, 
the second method of Lyapunov, is becoming increas- 
ingly recognized as having great potentiality, both for 
resolving nonlinear stability and performance problems 


[i recent years the demands for a means of non- 


* Received by the PGAC, December 10, 1960; revised manu- 
script received, March 15, 1961. This paper is based upon “A Modi- 
fied Lyapunov Method for Nonlinear Stability Problems,” Ph.D. 
dissertation, Stanford University, Stanford, Calif.; November, 1960. 
This dissertation gives a more detailed discussion of the theory and 
applications. 

+ Sunnyvale Development Center of the Sperry Gyroscope Co., 
Sunnyvale, Calif, 


and for providing a different philosophical viewpoint 
for the general control field. 

The fundamental concepts of the method appeared in 
a Russian publication in 1892. As presented by Lya- 
punov it was not supposed to handle the kind of prob- 
lems associated with automatic control, but the provi- 
sion for modification and extension was evident, and 
to some extent indicated, in the original statement. 
Modern researchers, mostly in Russia, have been con- 
cerned with developing a general theory of control 
using this as a basis. j 

The Lyapunov method is essentially a stability cri- 
terion which uses a generalization of Lagrange’s theo- 
rem of minimum potential energy to establish condi- 
tions for equilibrium. The principal device that provides 
this information is a function, called the Lyapunov 
function, which varies in magnitude according to the 
state of a system. It is the generation or induction of 
these functions that poses the major problem in the 
process. 

The Lyapunov stability criterion deals only with ar- 
bitrarily small disturbances. While this is adequate for 
linear systems and various applications in mechanics, 
nonlinear control problems require a knowledge of the 
behavior of systems in response to large disturbances. A 
generalization of the original theorem which applies to 
arbitrarily large and arbitrarily small disturbances and 
to intermediate conditions as well is given in this paper. 

In contrast to the success that has been achieved in 
advancing the theoretical concepts of stability by this 
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method, little has been accomplished in the way of 
formulating practical means for applying them to spe- 
cific problems. This is due to the lack of formal processes 
for producing Lyapunov functions. However, many 
problems that could be treated in no other way have 
been resolved by a fortunate combination of manipula- 
tion and guesswork. 

A method which is easily applied to many of the sys- 
tems encountered in automatic control and which has 
given good results for numerous examples is presented 
here. It is based on the observation that the quadratic 
part of the Lyapunov function must give stability infor- 
mation for the linearized equation of motion of a sys- 
tem. The procedure permits several modifications to 
cover a broad range of the circumstances that can occur 
in the general control problem. 


I. REPRESENTATION OF CONTROL SYSTEMS 


For the concepts of stability and control of a system 
to have any meaning, the system must be capable of 
changing its state, in some sense of the word; and if it 
possesses this property, there is some mathematical 
means for describing the nature of the change. For the 
systems considered here, this is the differential equation 
of motion. Specifically, this discussion is concerned with 
a system of the type shown in Fig. 1. It is a plant—a 
dynamical system or otherwise—whose outputs are to 
be regulated by means of a set of inputs which are com- 
pared to certain output variables. The differences are 
operated upon by a controller, which in turn supplies 
signals to the plant. In addition, both the plant and con- 
troller may be subjected to the influence of various un- 
controlled or free inputs. These represent such things as 
temperature variations, component aging or other par- 
ametric excitation. This is essentially a conventional 
control system. 

It is assumed that the system can be represented by 
a normal set of equations of the form: 


te = fil; Xk re(t), Us(t)) 1, J at 1,2, Ei tae 
k= 1,2,-"-50 
Ss LDS rome Magen 0) 


While this can always be accomplished in theory it is 
easy to conceive of cases where the solution of high- 
order or transcendental equations is necessary to pro- 
duce this form. The explicit dependence of the equations 
on time is broken into two parts, the reference inputs 
r,(t) and the free inputs u,(t). The x; represent the mag- 
nitudes of n different variables which completely specify 
the state of the plant and controller. They are called the 
state variables or, from a geometrical viewpoint, they 
form the components of the state vector. 

Any condition where all of the state variables are 
constant is called an equilibrium position. This is char- 
acterized by all of the functions f; in (1) being equal to 
zero. The dependence on time of a physical system may 
be divided into those factors which influence an equi- 
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Fig. 1—General control system. 


librium position and those which do not. It is assumed 
that the 7;(¢) affect an equilibrium position of (1) while 
the u,(t) do not. Thus the 7;(¢) may include factors that 
are not specifically intended as reference inputs. The 
equilibrium position can exist only when the 7;(¢) are 
constant. 

The equation describing the motion has a solution 
defined as any set of functions ¢;(t) which, if they are 
substituted for the state variables x,;, satisfy the equa- 
tions of motion. Solutions are dependent on time in the 
manner prescribed by the equations of motion and also 
upon an initial state «j;9 and the time ¢p when this state 
occurs. Thus the notation ¢;(¢) is understood to imply a 
set of functions which have the value xj;o at a specified 


time fo; $;(¢) =@;(to, X;0; t). : 


In most practical cases the equations can be expressed 
in the somewhat simpler form: 


ay = fil%; iy «;°(t), u(t) 4,9 = the Obey OU) 
Se 2 "5 Q- (2) 


x;°(t) is defined as 7,;(t) for 7<p and zero for j>p. For 
convenience it is assumed that the equations are set up 
so that f;(0, u,(¢))=0; that is, there are no constant 
terms in the functions. This does not place any restric- 
tions on the system but only specifies the manner of 
writing the equations. With this mathematical descrip- 
tion, the system of Fig. 1 can be represented by the vec- 
tor block diagram of Fig. 2. Systems of this kind are the 
best suited for treatment by the Lyapunov method. 

To interpret the concepts of the Lyapunov method, 
the idea of an n-dimensional state space is used. Each 
of the state variables is imagined to represent a length 
along an axis in this hyperspace. If the variables are 
functionally independent, no three axes lie in a plane. 
Under certain circumstances, the equation of motion of 
a system may be set up as a single differential equation 
of mth order. 


d"y ary dy 
ra ( eye 1)=0 3 
jis ie re (3) 


With the substitutions x;=y, «.=dy/dt, etc., a special 
form of (1) or (2) is immediately produced. In this case 
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Fig. 2—Equivalent control system. 


the state space reduces to the conventional phase space 
in which each succeeding axis represents the rate of 
change of the quantity measured along the one preced- 
Teor eae aes 

Any point in state space is represented by a vector 
having the various state variables as components. The 
totality of all points in the space represents all possible 
states which the system may assume. With the passage 
of time the state vector traces a curve in the space, 
known as a system trajectory. Fig. 3 is a possible tra- 
jectory in three-dimensional space. It may be thought 
of as the projection of a solution of the equations, 
plotted in a space containing the n-state axes and a 
time axis, onto the state space. Such a space and the 
projection is shown in Fig. 4. 


I]. DEFINITIONS OF STABILITY 


Solutions of equations may be divided into general 
classes according to whether or not they possess certain 
properties. The class into which a solution falls can 
often be determined without knowledge of the solution. 
One useful division is into the classes stable and unstable. 
The primary purpose of the Lyapunov method is to 
furnish a criterion by which an investigator can decide 
into which of these categories the solutions of a particu- 
lar system fall. 

To make the decision, a definition of stability is re- 
quired. Various definitions of stability for a specified 
state of a dynamic system are available. The concept is 
somewhat arbitrary depending on the particular re- 
quirements for the system. A set of definitions for vari- 
ous applications is presented by Ingwerson [2]. Some of 
these are repeated here. 


Stability in the Sense of Lyapunov 
Let ¢;(t) be a solution of the set of equations, 


ti = fi(xi, 0), (4) 


and define a new set of variables; g:=x;—@i. If these are 
substituted into (4), a new set of equations results which 
has an equilibrium position at g=0. This is true whether 
the original equations possess an equilibrium position 
or not. 

The equilibrium position is called stable in the sense of 
Lyapunov if for every €>0 there exists a 6(€) >0 such 
Pe that Ila (o)|| <e whenever || @(t0)|| <6 for all ¢>t. In 
~ other words, the equilibrium position, q=0, is stable if 
the magnitude of the state vector g can be made to re- 
main below an arbitrary upper bound by choosing for it 
aa sufficiently small initial magnitude. If q approaches 


a - g~ 
“ 5 Dee 
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Fig. 4—Projection of a solution. 


zero as ¢ approaches infinity the equilibrium position 
is called asymptotically stable in this sense. 


More General Definitions of Stability 


The preceding definition applies only to the behavior 
of solutions in an arbitrarily small region of state space 
about the equilibrium position. It is sometimes called 
“stability in the small” or A stability. 

Let the reference inputs to the system of (1) be con- 
stant. Then a broader definition of stability is stated: 
an amplitude position of x. of (1) is stable in a region 
R in state space at a time ty if for every €>O0 there exists 
a 8(e)>0 such that |\(to.) —o2(to)|| <8 implies||.(¢) 
— o2(2)|| <e for all di(to) and o2(to) in R and all t>to. 

This definition eliminates the three unstable phenom- 
ena, unbounded variations, other equilibrium states, 
and limit cycles from those solutions which satisfy its 
requirements. The equilibrium position is called asymp- 
totically stable if in addition @(t)—>x, as t>. It is called 
neutrally stable if it is stable and not asymptotically 
stable. 

The region R may be specified as arbitrarily small, 
finite, or arbitrarily large. If it is of a specified finite 
size the solutions are called B stable or “stable in the 
large.” If it may be chosen arbitrarily large the solu- 
tions are variously said to be B,, stable, “stable in the 
large,” “stable in the whole” or “globally stable.” For 
convenience the prefixes B and B,, are used here. 
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Stability of Systems with Forcing Functions 


When the 7;(¢) in (1) are not constant, the stability of 
an equilibrium position can no longer be considered. 
However, if the 7;(¢) were held constant at any time, a 
corresponding equilibrium position would exist. Thus a 
time-varying set of references may be thought of as an 
effective movement of an equilibrium state from point 
to point in state space. 

Let x(t) be the equilibrium position corresponding to 
a set of reference inputs 7;,(t) and let (to) =x-(to). A 
system is stable at to with respect to this set of inputs if 
o(t1) falls inside of a region for which the equilibrium 
position corresponding to 7;(t1) is stable by the previous 
definitions for all 4; >¢). Evidently, if a system is to be 
stable for all possible inputs, all equilibrium positions 
x-(t1) must be B,, stable. 


Ill. STABILITY CRITERIA 


The preceding section gives several definitions of sta- 
bility. Now it is desired to find criteria and general 
methods for applying them whereby the stability of 
specific systems can be determined from a consideration 
of the differential equations of motion. The definitions 
supply both necessary and sufficient conditions for a 
system to have stable solutions; however, a criterion for 
stability, based on a definition, may provide only a 
sufficient condition. This is the case in most applications 
of the Lyapunov method. 


The Second Method of Lyapunov 


The basis for the procedures outlined here, as well as 
for a variety of other modifications, is the original sec- 
ond, or direct, method of Lyapunov. It was intended to 
determine the stability of a position or state of motion 
of a dynamic system in response to small disturbances 
and, therefore, is valid only for “stability in the sense of 
Lyapunov.” A complete statement of the stability 
theorem is found in Lyapunov [3] and is repeated in 
more modern terminology by Hahn [4], Kalman and 
Bertram [5], and Cunningham [6]. 

The criterion applies directly to the equations of the 
disturbed motion derived from (4) by the substitution, 
gi=xi—9:(t). The new equations are: 


Gi = filgs + Oi), 0 — filds, 0) = Og; 1). — ) 


The Lyapunov criterion for the stability of (5) can be 
stated as follows: If there exists a positive definite func- 
tion V(qi, t), continuous in q:, such that its derivative with 
respect to time, V(qi, t), is negative or zero for all t>to, the 
system 1s stable in the sense of Lyapunov. 

V is called a Lyapunov function for the system. V(qi, 
t) is defined to be positive definite if it is positive for all 
l|q|| >0 and all t>t9 and is zero for g=0. For example, 
qi?+qo*Log t, is positive definite for t>1 while, 
gi? +q27e', is not positive definite since the coefficient of 
go” becomes less than any positive constant. Functions 
which are always positive or zero are called “non- 
negative” or “positive semi-definite.” 
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The derivative of V is to be taken along a trajectory 
of the motion. That is: 


: OV OV 
== 01(q;, t) ie 62(qi; t) ae a 
Ogi 0g2 
a OV a, ( ye OV (6) 
— 6, a: oo es or 
F) 2 al 


n 


V is then a function of the components of q, although 
not necessarily all of them, and time; it must be either 
negative or zero at every point in state space for sta- 
bility. Clearly, the result would be the same if V were 
negative definite and V were positive or zero, and so the 
terms “negative” and “positive” may be interchanged 
in the statement. 

This is a valid criterion for stability but only for arbi- 
trarily small deviations from equilibrium. To show that 
it is not sufficient to determine stability for large dis- 
turbances an example of Barbasin and Krasovskii [7] 
is cited. Let a system be described by the following 
equations: 

6x4 


x1 = SS 2X2, — 


Geiss 


2(a1 + x2) 
(1 ay Bale \ 


That the system is stable for small disturbances may be 
seen by linearization about the point x=0; however, the 
slope of the trajectories along the hyperbola 


(dx2/dx1)7 = 


1 49798, foes 
This is greater than the slope of the hyperbola, 


1 
(dx2/dx1)¢ => — ) 


2 


os X11 


for 


Since #1 is positive along this curve, all system trajec- 
tories are going into the region bounded by it and none 
are leaving. In any region R that includes a part of this 
region, the system is unstable. 
But assume as a Lyapunov function the positive 
definite function given by the following relation: 
ae eee 
= = —— + x27. 
1 a 432 


The derivative along a trajectory of (7) is: 
12%,? Ary? 
(Tet) Saeete Cl ety: 


which is negative definite. These conditions imply sta- 
bility by the above criterion but only for arbitrarily 
small disturbances. 
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A Modified Lyapunov Criterion 


To investigate the stability of systems represented 
by (2) for finite disturbances, let the references «;°(t) 
be fixed at a constant value at some time f; in accord- 
ance with the definition given for the stability of systems 
with forcing functions. Define, g;=x;—x,9(t1), for t>¢h. 
Eq. (2) then becomes 


qi = FAG us(t)). (8) 


The following theorem gives a stability criterion for 
(8): The equilibrium position, q=0, is stable in a region 
R at a time to tf there exists a continuous function, 
V(qi, t), which ts zero at the equilibrium position and is 
greater than some positive definite function, W(q:), for 
t>to, elsewhere in the region, and such that: 1) one of the 
surfaces, V =a constant, bounds the region, 2) the gradient 
of the function, VV, 1s not zero anywhere in the region ex- 
cept at the equilibrium position and 3) the derivative of the 
function with respect to time, V(qi, t), is negative or zero 
inside of the region. 

The quantity VV is a vector with components 
0V/0qi, all of which cannot be zero simultaneously in R 
except at the equilibrium position. This is equivalent to 
a statement that the function cannot have a relative 
maximum inside the region. In general, when the u,¢ are 
not constant, the boundary of the stable region varies 
with time. The above conditions assure that if q falls 
inside of R at any time it will remain permanently in- 
side of some bounded region. 

To prove this theorem observe that in the neighbor- 
hood of q=O there is some surface, V(q:, t) =a positive 
constant, which completely encloses the point q=0. 
This follows from the requirement that V be greater 
than a positive definite function. At the same time 
another surface for which V is equal to a larger positive 
constant exists which encloses the former one. Thus a 
series of hypersurfaces exist in state space, characterized 
by a series of constants which increase monotonically as 
the distance from the origin increases. These continue 
out until a point is reached where the gradient of the 
function vanishes. Surfaces beyond this point may cor- 
respond to smaller constant values than for the surface 
passing through the point. 

The requirement that V be nonpositive assures that 
the system trajectories in R either remain on surfaces 
of constant V or cross them toward the equilibrium 
position. In time-varying systems the position of a sur- 
face V(qi, t)= Vo may change but it is always bounded 
by asurface W(qi) = Wo since V> W. Similarly a surface 
V(qi, t)= Vi, where Vi< Vo, is bounded by a surface 
W(q:) = W:, where W, can be chosen smaller than Wp. 
Therefore, all trajectories initially in R remain bounded 
and the bounds are dependent upon the initial states in 
accordance with the definition of stability given previ- 
ously. ; 

“If this theorem is applied to the Lyapunov function 
;, given for (7), a boundary for the stable region is de- 


we 
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termined. The gradient of the function is 


241 
w= (_ 2), 
(1 + aie) 


which vanishes at the origin and at the points, x=(+ «, 
0). The equation of the boundary, V=a constant, pass- 
ing through these points is x2(1+,”)=1. This curve, 
shown in Fig. 5, includes an infinite region, but not all 
of the xx, plane. 


Fig. 5—A stability boundary for (7). 


Since V is negative everywhere, all trajectories inside 
the bounded region tend toward the origin, and the 
solutions are asymptotically stable. Outside of the re- 
gion, the solutions may or may not tend toward equi- 
librium. As with the original criterion, this theorem 
gives only sufficient conditions for stability. Another 
Lyapunov function may give another region of stability 
which includes more of the x1x2 plane. 


IV. GENERAL RESULTS 


Few general results, derived by the Lyapunov method, 
are yet available. Because of the specialized nature of 
the equations to which they apply, those which are 
known are more valuable for the theoretical insight 
they give to the method than for application to specific 
problems. Three of the most common results are given 
here to illustrate the use of the second method and 
to preface a discussion of more practical applications. 


A Result of Lyapunov 


Lyapunov gave the following result to demonstrate 
the second method. If the matrix of elements 0f;/dx;, 
formed for the differential equations, #;=f;(«;), is sym- 
metric, a Lyapunov function is: 


Vix) = — f° t(a)-de. 


This is a line integral which is uniquely integrable be- 
cause the symmetry of the matrix above is the condi- 
tion under which the curl of the vector f vanishes. The 
derivative of the function is just —f’f which is non- 
positive. The condition for stability is the definite 
nature of V. 


1A prime following the symbol for a vector or matrix denotes 
the transpose of that quantity. 
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B,, stability exists if V increases monotonically with 
increasing x. A condition for this is that the eigenvalues? 
of the matrix with elements 0?V/0x,0x;, which is also 
the matrix with elements 0f;/0x;, be positive. The signs 
of the eigenvalues can be investigated by Sylvester’s 
inequalities; that is, they are positive if all of the prin- 
cipal minors and the determinant of the matrix are posi- 
tive. 


A Result of Krasovskit 


The result above is a special case of the following more 
general theorem given by Krasovskii [8]. Let B(x, £) 
be the matrix with elements 0f;/0x,; derived from the set 
of equations, #;=f.(x;, t), where f;(0, )=0. Then.B,, 
stability exists if the eigenvalues of the symmetric part 
of B (i.e., of B’+ B) are negative. This is proved (see [4] 
and [5]) for the autonomous case with a Lyapunov func- 
tion, V=f'’f. It follows for the general case from an 
application of the autonomous Lyapunov function, 
V=x’'x. This function obviously is monotonically in- 
creasing in x. Its derivative is: V=x’f+f'x. 

To show that V is negative definite, under the hy- 
pothesis that B’+B has negative eigenvalues, the 
scalar product of its gradient with the radius vector x 


is formed. 
VV-x = xf + f’x 4+ x'(B’ + B)x = V + xB’ + Bx. 


It is evident that the last term on the right is a negative 


definite form for the hypothesized condition. Rearrang- ~ 


ing terms and dividing by the magnitude of the state 
vector gives 


VV-x—V_ x’(B’ + B)x 


(Gabe tix) ts? 


The left-hand side of this expression may be written as 


( : ) 
WW {| === Jhon 
eoe e 


This quantity is negative everywhere except at the 
origin because it is equal to a negative definite quan- 
tity. Since it is the scalar product of the gradient of a 
function and a radius vector, the function V/(x’x)!? 
decreases in any radial direction away from the origin. 
V is a form of higher order than (x’x)!, and hence this 
function is zero at the origin. Therefore V is negative 
definite. 


Lyapunov’s Result for Linear Autonomous Equations 


The most instructive application of the second 
method gives necessary and sufficient conditions for the 
stability of linear, autonomous differential equations. 
The Lyapunov function, V =x’ Ax, has the derivative, 
V =x'(B’A+ AB)x, for the set of m equations 


x = Bx. (9) 


2 The eigenvalues of a matrix M are defined as the roots, \, of the 
characteristic equation, Det (M—dJ) =0. 
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A and B are n Xn matrices with constant elements. For 
any symmetric matrix C with positive eigenvalues the 
equilibrium position, x=0, of the set (9) is asymptot- 
ically stable if and only if the matrix A which solves 


B/A+ AB=—C (10) 


has positive eigenvalues. Referring to the usual stability 
requirement for linear, autonomous systems it 1s seen 
that A has positive eigenvalues if and only if the real 
parts of the eigenvalues of B are negative. Proofs of 
this theorem are somewhat complicated. Two different 
ones are found in [1] and [5]. 

This condition may be relaxed by permitting the 
derivative of the Lyapunov function to be negative 
semidefinite rather than negative definite. Then only 
one of the eigenvalues of C need be different from zero. 
A necessary and sufficient condition for the eigenvalues 
of A to be positive is still that those of B have negative 
real parts. For example, if the matrix element C22 is 
taken equal to unity and all other c,; are zero, the solu- 
tion of (10) for the second-order set 


(eee 
Xo = —i@9 aa. Xe ‘ 
1 & ) 
2aiayiXO- cay 


A Lyapunov function and ‘its derivative are 


Ae 


V 


(dex? + 22?) 


2a1a» 


V=-— 


The vanishing of a,, which is the condition for neutral 
stability, causes the function to become infinite; how- 
ever, multiplication by the factor in the denominator 
gives a function which is valid for that case as well. 
When Bs derived from an equation of the form 


ge sie aye) > fast Vid ae On—1y + any = UF 


by the substitutions, y=x1, j=%x», etc., it has the special 
form 


0 0 
Os aD 0 

ao (11) 
Goma, 30 Leste ned, 
ae ee Ca ee ee Ce, 


A set of the matrices A for systems up to the fourth 
order are shown in Table I. These are derived by setting 
successive elements on the principal diagonal of C equal 
to unity while the remaining elements are zero and solv- 
ing (10) when B is of the form given above. In each case 
a factor appears in the denominator. Both of the 
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| TABLE I 
) MATRICES OF LyAPUNOV FUNCTIONS 
j E 
Second Order 
eat. Pye ad, 0 ae ( 0 
4 : Ome 0 2a 
L fee ar?+a,. ay Che 2a,a2 5 
ay 1 0 0 
Third Order 
a3” d2d3 0 @ @ 0 
Ai = |aods 103+ a2? as < C= |0 0 0 
0 ds dy 5 - (0. 0 2(aa2 — as) 
a a3 a3 QO. 2 =f 0 (0) 0 
Acs=1a3 @?+a. Zz Cy= |0 2(a1a2.— a3) 0 
0 eo eG ae 0 0 0 
a. Gd? — dod3 + ay2az3 22 2 — as} 3 2a3(aia2 — a3) O O 
A; = ay7a2 a3 + az Geof C3 = 0 0 0 
a\d2 — a3 ot ee pe 0 0 0 
_ Fourth Order 
Ro = ad2 — 3 Rs = aG2d3 — a3? — ay?ag 
34” PGES 20304 — a2 0 
: a . 443? Maye + a; ‘ G23” — a304 
a Bos G3d4 — aa.2 3 dod" aa3” + a2?a3 — Qya2d4 — O30 as 
: 0 = igh as? dag — a4 
cq 0 Ofes- 0 0 
“ 0 aie ES ; 0 0 
n 0 0 <a¥f " 20) ip 0 
0 OU 0 2k; ) 
- ; Gio i ae 5 304 0 
Ree ae 1032 + a4Ro as + ay7a4 ‘ a4 


a3? + ards a17a3 + a2d3 — aay 


_ a4 a3 
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matrices A and C in the table are multiplied by this 
factor. 

When B appears in the general form the same process 
can be used to find Lyapunov functions, but the task of 
computation is more tedious. Ingwerson [1] gives a 
simpler method for deriving these. The two matrices of 
second order for the general case are 


| bo: —bi1b01 | 
A, = 
—b41b01 bi? + bi1b20 aaa by2b01 
— bo0? + bi1b22 = by2b04 RE 
Os eenireiny bintra ite 


V. GENERATION OF LYAPUNOV FUNCTIONS 


Lyapunov’s result for linear, autonomous equations 
gives a means for checking any general method for de- 
riving Lyapunov functions. A general process should 
give the same results as are achieved by that method 
when it is applied to linear problems. There are, of 
course, any number of ways this could be accomplished, 
most of which would not give necessary and sufficient 
conditions for nonlinear systems. The Lyapunov 
method, however, is useful largely because it requires 
only sufficient conditions for stability. It is impossible 
to find the exact solution of most nonlinear problems by 
analytic means. Thus the conditions derived are nearly 
always conservative estimates. 

It is considerably less difficult to make a good ap- 
proximation for a Lyapunov function for a particular 
equation than to approximate a solution because, ex- 
cept for neutrally stable systems, Lyapunov functions 
are not unique. As is apparent from the previous dis- 
cussion a great many functions which solve linear prob- 
lems can be found by varying the matrix C. 

If the set of autonomous equations 


C= tx) (12) 


are differentiated there results 
x = B(x)x 


where B(x) is the matrix with elements 0f;/dx;. Eq. 
(10) may be solved for a matrix A(x) if the constant 
matrix, B, is replaced by the variable one, B(x). In the 
linear case it may be observed that A is the matrix with 
elements 4(0?V/0x,0x;). If this were also true for the 
matrix A(x), a Lyapunov function could be found by 
performing two integrations. The procedure would give 
the correct answers to linear problems as is desired of a 
general method. 

Certain conditions are necessary, however, for the ele- 
ments of a matrix to be the second partial derivatives of 
a scalar function. First, the matrix must be symmetric, 
which is true of A(x), but also the relation 


0a;; Odix 


OX, Ox; 
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must exist for the elements of A(x). The latter condi- 
tion is not true in general for matrices so derived. Nev- 
ertheless, A(x) has a desirable property; the Lyapunov 
function derived from A(0) is valid in the vicinity of the 
origin. It gives correct results for the linearized part of 
(12) and is, therefore, a first approximation. If. the 
quadratic terms in its derivative do not predict stability, 
the system is unstable. 

A simple means of forming a Lyapunov function 
from A(x) often gives good results. A matrix A(x;, x;) 
is formed by letting all of the variables in each element, 
ai;, of A(x) vanish except x; and x;, where z and j are the 
respective indexes of the row and column containing the 
element. The gradient of a scalar function is then found 
by performing the following integration: 


WW = { ‘Alaea nas (13) 
0 


This is not a line integral; the integration is to be per- 
formed over each component of x as if the remaining 
variables were constant. The result is a vector with nu 
components whose curl is zero and, hence, is the gradi- 
ent of some scalar function. A more precise definition of 
(13) and a proof that the vector is a gradient can be 
given with the aid of tensor notation. These are found 
in Ingwerson [1]. An example will serve to illustrate the 
meaning here. 

The matrix B(x) for the third-order system described 
by 


X41 = Xe 
Xo == Ls 
X3 Si ge (a1 a CX) — bx 


is derived as discussed above. 


0 1 0 
B(x) = 0 0 ie 
—3 (a1 + cx)? —3e(x%1 + cae)? —b 
This has the same form as (11), but with variable ele- 
ments. The third-order matrix corresponding to A» in 
Table I is 
3b(a1 + cx)? 3(%1 + cx)? 0 
A2(x) = |3(%1 + cx)? 6? + 3c(a1 + cxe)? 5]. 
0 pe ef 
It is the same as A: except that the constant elements 
are replaced by corresponding variable ones. 


The matrix A2(«;, x;) is produced by letting certain 
of the variables in A2(x) vanish. 


3(a1+ ca)? 0 


36x12 
Ao(x;, Xj) = 3 (41 “+ CX»)? b? + 3c3x92 b 7 
0 b 1 
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Performing the integration indicated by (13) yields the 
following gradient: 


+3 


1 : v1 
bay See tex) *® = ——— 
VV == < C 
(%1 + cx)? + bx. + bas 


bx2 + x3 


A Lyapunov function is found by evaluating the follow- 
ing line integral along any path of integration: 


% bay4 x 6X2 =: aie bx? 
es Eg ES ra 
0 + Ac Ac y 


+ bx2%3 ies — 
When 0, c and the quantity bc—1 are positive, V is posi- 
tive definite and its gradient vanishes only at x=0. This 
can be verified by examining the zeros of the gradient, 
by applying Sylvester’s inequalities to the matrix whose 
elements are 0?V/dx;0x;, or just by inspection of the 
function. 

The derivative function is determined by forming the 
scalar product of the gradient and the derivative of the 
State vector: 


V = W-x = — (be — 1) (3x12 + 3cxyx_ + 62x07) 422. 


It is negative semidefinite under the same conditions 
for which the Lyapunov function is positive. Stability 
of the equations of motion is therefore assured for 
b>0, c>0, and bc—1>0. In this case, the conditions 
are also necessary, since if bc—1 is negative, there is 
still some part of state space arbitrarily near to the 
origin in which V is positive. V is also positive there 
and hence some trajectories must diverge from equi- 
librium. 

The above procedure thus produces a Lyapunov func- 
tion which yields both necessary and sufficient condi- 
tions for this particular example. It is not, however, a 
strictly formal method that may be applied to any 
problem with assurance of valid results. The selection 
of the matrix A(x) requires a certain amount of ingenu- 
ity. If either of the other two matrices in Table I were 
used, the same result would not be achieved. The 
matrices in Table I are each designed to give one quad- 
ratic term in the derivative function when the system 

is linear. Often only one of these gives useful information 
for a nonlinear system, as is true in the preceding ex- 
ample. More frequently, it is necessary to form some 
linear combination of Lyapunov functions derived from 
the various matrices. Occasionally, it requires a matrix 
which is determined by selecting some of the off-di- 
_ agonal elements of C in (10) to be other than zero. 
These are not given in Table I but are easily calculated. 

When A(x) is determined, the matrix A(x, x,) is de- 
fined by neglecting certain variables in each element. 
It is often apparent after a function has been AOU aes 


; ae a 
Ya ae 
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that a modification of the matrix would produce more 
desirable results. Only one kind of modification is con- 
sidered. This amounts to dropping more of the variable 
terms in the matrix, thereby simplifying the resulting 
functions. The integrability conditions are not altered 
by this variation provided that the symmetry of the 
matrix is retained. 

The particular modification that has proved the most 
useful is applied when powers of the elements of B(x) 
occur in A(x). For example, the matrix A, in Table I 
contains an element, a3?, in its first row and column. In 
general the corresponding A(x;, x«;) would contain an 
element a@3?(«1). It is often more desirable to replace this 
by the term as3(0)a3(«1), in which the variable is neg- 
lected in one of the factors and retained in the other. 


VI. EXAMPLES FROM NONLINEAR FEEDBACK SYSTEMS 


The method discussed in the preceding section re- 
stricts the field of possibilities from which to choose a 
Lyapunov function to those which can be produced 
from a certain class of matrices. Its most important 
function is to eliminate the linear aspects of a problem 
from consideration by giving the known correct answers 
for those parts. The selection of a matrix and perhaps a 
modification of its elements remain at the discretion of 
the investigator. To illustrate these points, various 
applications to nonlinear control are presented. 


A Nonlinear Compensation 


Fig. 6 shows an undamped second-order system which 
is made asymptotically stable by regulating the gain of 
an amplifier rather than by conventional linear com- 
pensation. The gain is made to vary as 


K(e, 6) as by rare b1€6. 


r(t) 


Fig. 6—A nonlinear compensation. 


The equation of motion is, 
K(e, 6)(r — 6) = J6, 


or with the substitutions, 9=x1, 6=xe, r(t) =x1°(t), and 
x2°(t) =0, it is expressed in the form of (2). 


vy = Xo. — x29 
b 
0 1 
Xe = a (a4 = 41°) os Fi (a1 — 41°)?(%o — x2), 
Using the definition of stability for systems with refer- 


ence inputs given in the second section, «;° and x2” are 
held constant after some time f;. Then for t>¢,, the 
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additional substitution, yi=x1—x1 and yo=x2—x,%, 
reduces the above equations to 


V1 = Veo 


bo Dies 
ar re = pee 
If these are B,, stable, the system is stable for all inputs. 
The matrix B(y) is 


0 1 
by | 2s ore 
7 Uni cen 
PR ae eae 


The first matrix of Table I is used to form the Lyapunov 
function 


bo 
A(yi, 5) = |J 
Oe 2 


From this, the procedures of the previous section give 


V= ee we a yor 
Dui 2 
Wi = (= V1) y2) 

Ui 
Vi wet 9 
7 Vio 
Fee Nag + 1+ p)w? + 2Kw?(2cDwo + 1 + p)6(x1) 
2Dw + 2Kcew6(x1 + cx) 
ene eee + 1+ p)w'x, + Kw?(2cDw + pw) sgn x1 + 2Dwx, + Kw? sgn (41 + x2) . 
2Dwx, + Kew? sgn (41 + cx.) — Kew? sgn cx. + (1 + p) x2 


For positive by) and 0;, V is positive definite and V is 
negative semidefinite. Unless a trajectory follows the 
41 Or ye axis, which is obviously not possible, the system 
is asymptotically B., stable and the compensation is 
accomplished. 


A Discontinuous System 


Fig. 7 shows a linear system whose actuating signal is 
switched positive or negative according to the sign of 
the linear switching criterion 6+c6. With the substitu- 
tions 0=x; and 6=x»2, the equations of motion are 


x1 = Xe 


to = — Kw? sen (x1 + cx) — waxy — 2 Dax. 
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Fig. 7—Linear second-order switching. 


The Dirac delta function 6(x) is defined as having in- 
finite magnitude at x=0 and zero magnitude for all 
other values, but in such a way that 


i 0) dele 


In terms of this function, it may be said that 
d/dx sgn x=26(x). Then for the equations above, 
0 1 


B(x) = ; 
—w?—2Kw"6(aj+cx%2) —2Dw—2Kcwd(%1+ x2) 


A combination of the two second-order matrices 
from Table I, wA:+ As, can be used to find a Lyapunov 
function. It is obvious that the element a1:(x) must be 
modified, for otherwise it would contain the square of a 
delta function which, when integrated, leads to an 


_ infinite magnitude for the gradient. A modification in 


which the delta function is neglected in one of the fac- 
tors of a;?(x) and retained in the other is used: 


2Dw + 2K cw6(x1 + CX») 
tty 


Integration of this matrix according to (13) gives the 
gradient of a function: 


The derivative of the function is found by combining 
the gradient with the original set of equations. 


V = — 2De(w?x,? + px?) 
— Kcw4[1 + sgn (cae) sgn («1 + cae) | 


- Ke'| (De eect (20. 2 “) cm | 
C 


“sgn (41 + cae) + Kw?(u + 2¢Da)«2 sgn «1 
+ Kew (wa, + 2 Dx2) sgn cxe. 
While these results may give an accurate solution to 
the problem, they are rather complicated. An inspec- 


tion of the derivative and gradient offers a means of 
simplification. First, if wu is set equal to wc”, one of the 


Ag 
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terms becomes nonpositive. The terms containing sgn x; 
and sgn cx, complicate the derivative. From the gra- 
dient, it may be seen that these could be dropped with- 
out destroying the integrability condition. If these vari- 
ations are made the Lyapunov function, its gradient 
and derivative are 


x 2 
= (4D? + 1 + wc?) —_ Bee) Dasrixe 


+ Ko*(01 + cx) sen (x + ers) + (1+ wet) = 


(4D? + 1+ wc)w?x1 + 2 Dox, + Kw? sgn («1 + cx») 
2Deax; + Kew? sgn (x1 + cx.) + (1 + wc?) are 
— 2 Dw («7 + ca2) — K2cw4 
— Kw*(2D + cw) ("1 + cx) sgn (a1 + cx). 


W = 


Y= 


The Lyapunov function is positive-definite since the 
only term that causes it to differ from a function for a 
linear differential equation is non-negative. It is in- 
teresting to consider the case where the linear system 
has negative damping. For simplicity, let K=w=c=1, 
and let D= —3. Then 


3 


a re By" — X24 (x1 + Xo) sen (41 + Xa) + x22, 


and 
V = x2 + xo? — 1. 


The derivative is negative inside of a unit circle which is 
shown by the dashed curve in Fig. 8. The curve V=7/4 


SWITCHING 
BOUNDARY 


Fig. 8—Stable region for negative damping. 


touches this circle at the switching boundaries and, ac- 
cording to the modified theorem given in Section III, 
encloses a stable region. It may be concluded that this is 
a good approximation since the curves, V=a constant 
and V =O, fall so close together. 


A General Nonlinearity 
_The third-order equation 
y + ay + ag + flyy = 9 


en 
7 Pie 


ee 
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is asymptotically B,, stable if the roots of its character- 
istic equation, calculated as if f(y) were constant, have 
negative-real parts. To prove this, a matrix is derived 
from (10) by letting C(x) be the following matrix: 
2a2yf +f) 0 yf +f) 
0 0) 0) 
2(yf' +f) 0 


2a 


B(x) has the form (11), and the resulting matrix is 


ao” + ailyf’ + f) CALE) Op) 
A(x) = a\Q2 ay + ae Qa!|. 
a2 ay 2 


Integrating this matrix gives the three quantities: 


a2’y + aif(y)y + aiaey + ari 


VV = | Gyaoy + (ax* + a3)y + aw |, 
doy + ay + 24 
Ve ae y+ a J tors + ayaayy + (a1? + a2) z 
+ any + ary + 5%, 
and 


V = [aof(y)y? + 2f(y)¥9 + avy? ]. 


The derivative is nonpositive under the conditions 
a1>0, a2>0, f(y) >0, and aia2—f(y) >0. The Lyapunov 
function is positive definite if the first three are fulfilled. 
These conditions are just the Routh-Hurwitz inequal- 
ities for the characteristic equation defined above and 
are necessary and sufficient for the characteristic roots 
to have negative-real parts, which proves the state- 
ment. It cannot be concluded that these are necessary 
requirements for stability since if they are not satisfied 
the derivative becomes indefinite but not positive semi- 
definite. 


CONCLUSIONS 


A criterion for stability and a method for applying it 
to many of the nonlinear problems associated with con- 
trol systems have been presented. The approach has 
been to admit that a certain amount of experience and 
ingenuity are required if other than very specialized 
situations are to be handled, but a plan of attack is de- 
veloped which quickly leads to the correct answers to 
some questions. The procedure is designed to permit a 
number of modifications for treating cases that are not 
amenable to the categorical application of the process. 
The examples were selected to illustrate various points 
concerned with application and modification of the 
method rather than for being representative of practical 
problems. 

Because the criterion gives only sufficient conditions, 
some judgment is required in evaluating the results. 
No fixed rules for doing this can be set down but certain 


210 


guides are possible. If the same requirements for which 
the derivative is nonpositive are also those which cause 
the Lyapunov function to be positive definite or mono- 
tonically increasing, the result is usually very good. In 
other words, both the Lyapunov function and its deriv- 
ative should satisfy the conditions imposed upon them 
with the least possible margin. If one-is maximized at 
the expense of the other, an inferior result is obtained. 

Modifications of the functions derived by direct ap- 
plication of the method are made with the objective of 
approaching this condition. It is often evident that the 
addition or deletion of a particular term will produce 
this effect, in which case the variation should be made. 
When both requirements are fulfilled by a wide mar- 
gin, there are many adequate Lyapunov functions, and 
there is no need to seek an optimum. 

This discussion has been concerned entirely with the 
generation of Lyapunov functions for stability analysis. 
As with other methods, stability analysis by the use of 
Lyapunov functions is closely related to other facets of 
control system design. Hahn [4] and Kalman and 
Bertram [5] describe some uses of the Lyapunov meth- 
od for other performance considerations. The functions 
derived by the method presented here are suitable for 
use in these applications as well. 
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A Mean-Weighted Square-Error Criterion for Optimum 
Filtering of Nonstationary Random Processes 


G. J. MURPHY}, memper, IRE, AND K. SAHARAt 


Summary—A procedure for use in the design of a physically 
realizable time-invariant linear system for optimum filtering of a 
nonstationary random process in the presence of nonstationary ran- 
dom noise is presented in this paper. First, a new criterion for system 
performance is defined. On the basis of this criterion, an integral 
equation for the optimum physically realizable weighting function is de- 
rived, and it is shown that in some cases an exact solution to this 
equation can be obtained through the use of double Fourier trans- 
forms. Then the use of a technique to obtain an approximation to the 
solution to the integral equation is discussed. 

This theoretical background is followed by an illustrative exam- 
ple in which the method is used to design the optimum physically 
realizable linear time-invariant filter for a Brownian-motion signal 
contaminated by Markovian noise. It is shown here that if the de- 
signer is constrained by the requirement that the system be a digital 
filter with finite memory, then an exact solution can be found. 

Application of the method in cases where the random processes 
are stationary is discussed next, and the suggested approach is il- 
lustrated in an example. 


INTRODUCTION 


HE EARLY work of Wiener! on optimum syn- 

thesis of a time-invariant linear physically realiz- 

able system has been extended?-* in several re- 
spects during the past two decades. Another extension 
is suggested in this paper. 

In some of the work® noted above, the criterion. for 
optimum performance is changed by changing the 
weighting of the error as a function of the error magni- 
tude. In other work,’* the criterion is modified by 
changing the weighting of the error as a function of the 
time at which the error occurs. It is proposed in this 


* Received by the PGAC, December 20, 1960. 

{ Elec. Engrg. Dept., Northwestern University, Evanston, III. 

1N. Wiener, “Extrapolation, Interpolation, and Smoothing of 
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8G, J. Murphy and N. T. Bold, “Optimization based on a square- 
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paper that a still different criterion be employed—a 
criterion in which the importance of the error is made a 
function of a subset of the sample space from which the 
error is taken. In the simplest application of this kind 
of error weighting, the criterion is of the form 


C= Dm; ep Pine;x(t), (1) 
j k 

if there is a finite or a countably infinite number of sub- 

sets and sample points in each subset, and of the form 


c= ma) [ra neessdarae, 2) 
if there is an uncountably infinite number of subsets 
and of sample points in each subset. In (1), Pj, is the 
probability associated with the kth sample point in the 
jth subset, and m; is a subset weighting parameter. In 
(2), p(x, y) is a probability density function and m(x) 
is a subset weighting function. Clearly, if m;=1 in (1) 
and m(x)=1 in (2), then this criterion reduces to the . 
familiar mean-square error criterion. In general, how- 
ever, it is a weighted mean-square error criterion. 

As an example of a possible application of this cri- 
terion, consider the problem of designing the suspen- 
sion system of an automobile for the “best ride.” One 
might obtain extensive data on road conditions and pro- 
ceed to design the system by use of the conventional 
mean-square error criterion. It seems reasonable, how- 
ever, to subdivide road conditions into the categories of 
city streets, country roads, and expressways (1.e., free- 
ways, tollways, turnpikes). It is to be expected that the 
statistical characteristics of these three categories differ 
from each other and from those of the complete en- 
semble, as well. It is now possible to introduce weight- 
ing parameters mm, m2, and ms; that indicate the rela- 
tive importance of a “smooth ride” in the city, on the 
country road, and on an expressway, respectively, as 
well as the probabilities P1, P2, and P; that the automo- 
bile will be on these respective kinds of roads. Then the 
criterion of performance can be taken to be 


C= m,P 4e1"7(t) + MP 2€27(t) + m3P 3e37(t), (3) 


where e;?(t) denotes the ensemble average of e?(t) over 
the jth subset. Inasmuch as it would be impractical to 
provide the automobile with three separate suspension 
systems that could be switched into or out of use de- 
pending on the type of road being traversed, a single 


YAW 
suspension system that is optimized with respect to the 
criterion in (3) appears to be the best system that can 
be constructed. 

Similarly, it would seem reasonable to design a fire- 
control system on the basis of a weighted mean-square 
error criterion, with a different weighting factor for 
bombers than for fighters. The weighting factors could 
be chosen on the basis of the destructive potentials and 
the relative target size, for example, of these two classes 
of aircraft. 

Furthermore, particularly in those instances in 
which one or more of the random processes is nonsta- 
tionary, it is sometimes desirable to weight the error as 
a function of time in addition to weighting it according 
to the subset from which the signal is drawn. (One may 
wish, for example, to accentuate the importance of er- 
ror at a set of sampling instants.) This can be accom- 
plished by the use of an integral of weighted square error 
or by the use of a time-mean weighted square error. 
Thus, the criteria presented in (1) and (2) can be gen- 
eralized to 


C= dim; >d Pa [ wu(eat(odt (1a) 


500) 


Or 


aes 2m; Ds Pa lim 


Y ed 


=f. wall Cjn? (t)dt, (1b) 


and 


c=f[ mo f rem f el VO davdn. (2a) 


lim —— 
To?” 2} 


je [me fv. y) 


To 
f w(x, y; t)e?(x, y; t)didydx. 


To 


(2b) 


It should be noted that if w,,(t)=w(x, y; t) =uo(t), 
where w(t) is a unit impulse function at t=0, then (1a) 
and (2a) reduce to (1) and (2), respectively. Similarly, 
albeit somewhat artificially, (1b) and (2b) can be re- 
duced to (1) and (2), respectively, by letting w,,(¢) 
=w(x, y; t)=2T.uo(t). For sampled-data applications, 
the weighting function w,;,(t) can be taken to be wyxt(t), 
where 2(t) is the unit impulse train, to obtain the sum 
of the weighted squares of the error samples; and for 
W j,=1, this reduces to the commonly used sum of the 
squares of the error samples. 

Arbitrary magnitude weighting of the error can be 
introduced, in addition to the time weighting and set 
weighting indicated in (1a), (1b), (2a), and (2b), by re- 


IRE TRANSACTIONS ON AUTOMATIC CONTROL 


May 


placing e?(t) with Fle(t) |. Thus, the general form of the 
criterion becomes 


ole he p(s 3), lim als y3To30 


-Fle(x, y; t) |dtdydx 


(4)° 
= (( sim foe 93. Fo; DE ea, 3D) lat) (5) 


where ({ ), and { )y 
y, respectively. 
This criterion is hereafter referred 


“MASTWE” (Mean-Amplitude-Set-Time 


Error) criterion. 


denote averages taken over x and 


to asi tite 
Weighted 


OPTIMUM SYNTHESIS 


For the present,*® let 
Fle(x, 9; 1)] = (x, 951). (6) 
Then, (5) becomes 


= (( tin lim ds wn, yi To: the? 2%, y; at) ) (7) 
= lim ae y; T,; te? (x, 9; £) y)adt (8) 
To” Ty 


if the order of the various operations may be changed as 


_indicated.!! 


Following the customary procedure, it is convenient 
now to define the system error e(f) as the difference 
between an ideal response 7(¢) and the actual response 
ol) alhatas, 


e(t) 9 i(t) — cl). (9) 
The relation between the actual response and the input 
to the system is determined by the weighting function 
g(r), 1f the system is a linear constant-parameter sys- 
tem. For such a system, 


c(t) -{ g(r)r(t — r)dr. (10) 


Eqs. (9) and (10) are presented graphically in Fig. 1. 


c(t) 


DESIRED OUTPUT 


Fig. 1—A diagrammatic definition of system error. 


® It should be noted that the impulse functions of «, y, and t may 
be contained in p(x, y) and w(x, y; To; t). : 

0 Other forms of Fle(x, y; t)] are to be investigated and reported 
in future papers. 

"For a discussion of conditions under which this change in order 
of operations is justifiable, see, for example, E. W. Hobson, “The 
Theory of Functions of a Real Variable,” Harren Press, Washington, 
D? C,, 2: vols,; 1950; 
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To simplify the notation, the following definitions 
are now introduced: 


lim 


Tp” 


A as " 
Wwii(t1, 72) = { ((w(a, y; To3 a(x, 3 £ + 71) 


To 


“4(%, vst + T2)),)edt, (11) 
A Po 
Wwri(T1, 72) = lim if ((w(x, ¥; To; t)r(x, y;t + 73) 
To» —To 
“U(x, y;t + T2))y)edt, (12) 
A To 
Yonri 72) * tim f (wl, 95 Tasdeley yit-+ 1) 
To —To 
“r(x, y3t + 72))y)edt. (13) 


Each of these three functions is a second-order correla- 
tion function. 

By substitution of (9) and (10) into (8) and introduc- 
tion of (11), (12), and (13), it can be shown that 


Os peo iy 22 ie Wa Oa 


ie fs J sdbent- ein ee, 


The optimum weighting function go(7), for which C 
assumes its minimum value, is now to be determined. 

Following the customary procedure based on the cal- 
culus of variations, we now let 


g(r) = go(r) + eh(r), (15) 


where h(r) is an arbitrary physically realizable weight- 
ing function satisfying the relation 


h(r) =0 


where 7'y is the length of memory of the system, with 
no discontinuity at 7=0 or at r=T7y, and where € 1s an 
arbitrary real parameter. A necessary condition for an 
optimum solution is 


aC 
de 


E << 0, ai SS Tu, (16) 


(17) 


Thus, it is found that the optimum weighting function 
must satisfy the relation 


fom [Yen(—n,0) 
is J eleaven(—ni = roaee| = ty tt8) 


if the usual change in the order of carrying out the vari- 
ous operations can be justified. 

Since f(r) is arbitrary and satisfies (16), (18) is 
equivalent to the requirement that 
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TM 
{ £0(T2)Wwrr( —71, —T»)dr2 = WVwril(—T1, 0), 


OVS ie) 


Whether satisfaction of (19) is also a sufficient condi- 
tion to insure that the g(7) in (15) yields a minimum of 
C(e) for e=0 can be ascertained by examining 


eos, iE h(r1) fi MG 
= mae 1 1 ( Wirrek 
de io 


If the change in order of the operations can be justified, 
(20) may be rewritten as 


aC ve 
a7 2 iim f ((w(a, ¥; 


de To?” = Po 


(20) 


1, —T2)dr2d71. 


is; ona, y; t) ne di, (21) 


where ¢,(x, y; t) is the response of a system with weight- 
ing function h(r) at time ¢ to the random input r(t). 
Clearly, (07C/ee)> 0 if ‘wi; 14 3t).> O'for all wy 
and ¢. 

A sufficient condition that go(r) satisfy (19) is that 


Dy ir(Jw, jw’) 


Go(jw) = (19a) 


Payer (Jor, jo’) 


where Go(jw) is a Fourier transform of go(r) and ®yi,(jw, 
jw’) and ®y,,(jw, jw’) are double Fourier transforms of 
Wwirl(t, Y) and Wurr(7, y), respectively. However, in some 
cases these double Fourier transforms do not exist, and 
in other cases the right-hand side of (19a) is not inde- 
pendent of w’. It is therefore not always possible to ob- 
tain an exact solution that satisfies the sufficient condi- 
tion (19a). 

An approximation to the solution to (19) can be ob- 
tained by regarding go(7) as a staircase function of 7 
(instead of a smooth function) and then requiring that 
(19) be satisfied only for a finite set of discrete values of 
T1>0. That is, (19) is replaced with 


N 
T >> goliT Wurr(—kT, —jT) = Wuri(—T, 0), 


j=—-L 


BO ea ours (22) 


where J is an arbitrarily small positive real number, and 
L and N are determined by the length of memory an- 
ticipated in the optimum system. Furthermore, the 
optimum physically realizable weighting function 
go-(t) is approximated by the solution to 


N 
TS gor JT)Wwor RT, —JT) = Vuri(—kT, 0), 


j=0 


eo aaa) 


Finally, (23) may be written as 


1 
Wore G op = — Pris (24) 
It 
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where 
£or(O) 
or if: 
eRe aA (25) 
Lor( NT) 
Wwrr(O, 0) Vwrr(O, we Nee Wwrr(O, i) 
wrr al 0 wrr als eat i 
Spee Yor ) Porn = 4 ) (26) 
CONE Ome ye aN De Tey ET: ONT) 
and 
Vinge Us 0) 
Wri He 0 
Pye Reema (27) 
ges —NT, 0) 


If a solution to (24) exists, it can be found by the usual 
method. The accuracy of the approximation is, of 
course, a function of N and 7. The designer will nat- 
urally choose 7 as small as possible and WN as large as 
possible, subject to the limitations of the available data 
and the computer to be used in solving (24) for Go. 

When a solution to (24) has been obtained, the de- 
sign can be completed by fitting the curve of g,,(kT) 
vs kT with exponentials and exponentially decaying 
sinusoids and then designing a realizable device with 
unit impulse response equal to the sum of these com- 
ponents. It should be noted that it is no more difficult 
to design a digital system (with sampling period 7) 
than to design a continuous system by this method. 
Furthermore, if the system is to be a digital system with 
finite memory, an exact solution can be obtained, as is 
illustrated in the following example. 


Example 1 
To illustrate the use of the MASTWE criterion, the 
following example is presented: 


Problem: The input 7(#) to the system illustrated in 
Fig. 1is 


r(t) = s(t) + nd), (28) 


where s(¢) is a Brownian motion with autocorrelation 
function 


dealt — x,t — y) 
Ee ere ee 
0, min (tf — x, — y) <0 


fey (22) 
and n(t) is a stationary random noise with autocorrela- 
tion function 


dnn(t — x,t — y) = 16e72!*-¥1, (30) 


The system is to be a digital (or sampled-data) sys- 
tem operating on samples taken at ¢=0, 1, 2, -- +, with 
finite memory of length M, where M is a positive in- 
teger. 

The two functions s(¢) and u(t) are independent, and 
it is desired that the output equal s(¢) at the sampling 
instants. The weighting function to be used, which is 


w(x, ¥; To; t) = tet D) u(t — n), (31) 


n=0 

is chosen to accentuate the importance of minimizing 
the error at the sampling instants in general, and at 
t=1, in particular. 

Determine the optimum physically realizable weight- 
ing function. 

Solution: First, the second-order correlation func- 
tions are determined. These are 


Varies =) 
To -) 
= lim te-' >) u(t — n)brr(t — k, t — jdt (32) 
To 0 —To n=0 
= Do ne"brr(n — k,n — §) (33) 
n=0 
% Dd ne (n — k) +16 D> nemre2l#-a, een 
n=k VR 
se : (34) 


bs Dd ne-*(n — j) + 16 D> nee21#-1, 0 < <j 


n=J n=0 


and 
Wuri(—k, 0) = 25 D) ne(n — k),. k>O. (35) 
n=k 
Numerical values of these functions, obtained by addi- 


tion of up to the first fifteen terms in the series, are 
presented in Tables I and II. 


1961 Murphy and Sahara: Mean-Weighted Square-Error Criterion 215 


TABLE I 
SECOND-ORDER Cross-CORRELATION FUNCTIONS 


k Vori(—R, 0) 
0 49.8 
1 Dow 
2 12.8 
3 5.9 
TABLE II 
SECOND-ORDER AUTOCORRELATION FUNCTIONS 
Yurr(—k, —j) 
f 
0 1 2 3 
k 
0 64.5 28.7 13 24 5.9 
1 2857 41.4 14.7 Om 
2D 13 4 14.7 DIRS 7.9 
3 5.9 6.1 7.9 20.6 


By choosing a length of memory (M) from 0 through 
3 and then substituting into (26) and (27) the appro- 
priate values from Tables I and II and solving” (24), 
one can now determine the optimum physically realiz- 
able weighting sequence g(m), n»=0, 1, -- - , M. The re- 
sults are presented in Table III. 


TABLE III 
OptimMuM REALIZABLE WEIGHTING SEQUENCE 


M g(0) g(1) g(2) g(3) 
0 0.77 0 0 0 
1 0.70 0.16 0 0 
2 0.70 0.14 0.08 0 
3 0.70 0.14 0.06 0.02 


APPLICATIONS TO STATIONARY RANDOM PROCESSES 


If the random processes under consideration are sta- 
tionary and 


w(x, y; To; t) = wil(x, y)we( To, 0), (36) 


then (8) may be rewritten as 


C = W((wilx, ye*(x, 9; t) yes (37) 
where 
A ce 
W = lim w(T>, t)dt. (38) 
To 0 —o 


- Thus, it is seen that in such a case the optimum weight- 
ing function is independent of the choice of w2(7%, #). 
Now let 


A ‘ - 

Oey 7a) = ((wila, y)r(t — ti)i(t—72))y)e (39) 

; 12 That the solution thus obtained does indeed yield a minimum 

of C for g(r) described by (15) can easily be ascertained by noting 
that since w(x, y; To; ¢) is a non-negative function, (0?C/de’) >0. 


"ea 


and 


Orr(T1 — T2) = ((wi(a, y)r(t — T1)r(t — T2))y)e. (40) 


Then it can be shown that for the case under considera- 
tion (19) becomes 


TM 
f Bol72) Orr(T1 — T2)drs = Ons(t1), -O<S7y< Ty. (41) 


00) 


If the memory is of infinite length (ze, Ty=~), 
then (41) is the Wiener-Hopf integral equation, and the 
exact solution for the optimum physically realizable 
transfer function is known to be 


fen 
Arr (s) 1+ 
Gor(S) fee ) (42) 


where A,,(s) and A,,(s) are bilateral Laplace transforms 
of 6,:(7) and 6,,(7), respectively, and A,,~(s) andA,,+(s) 
are obtained in the customary manner by spectrum 
factorization of A,,(s), and 


Ap; g 1 . Ari 
| 4 feral oa sds. (43) 
Ae (5) ais 0 20] —jo Arr (s) 
Example 2 


Problem: The input r(t) to the system illustrated in 
Fig. 1 is equally likely to be 


u(t) = s(t) + n(Z) (44) 


or 


v(t) = dt) + nd), (45) 


where s(t) and d(t) are signals and n(t) is noise, and all 
three are generated by stationary random processes. 
The desired output z(t) is the signal component of the 
input. The power spectral densities of s(t), d(¢), and 
n(t) are 


bul) => (46) 
Pies (47) 
Pa 
and 
Gnn(s) = 2, (48) 


respectively, and m(¢) is uncorrelated with both s(¢) and 
d(t). 

Determine the optimum physically realizable trans- 
fer function for the system, given that it is twice as im- 
portant to process d(t) accurately as it is to process s(t) 
accurately. 
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Solution: From the given information it is found that 


1 9 1 4 
aul) = +( -+2)+—x2x( ;+2) 
2\9— 3s? 2 4 — 5s? 
L3G 10ene 4.97) ca 
(een) (Soe 
and 
‘s 1 ( 9 4 i EN ( 4 ) 
nh) = 2 \9— 4 2 4—s° 
( =) 
gs? ee EBS 
Li? 17 
= (50) 
2 (s? — 9)(s? — 4) 
It follows that 
— (s + 3.3)(s + 2.2) 
(aes — 3 ou! 
ee SG5)6 2D te 
and 
ta fe eee (s — 3.3)(s — 2.2) 
Ary (s) nae V3 (s = 3)(s a, 2) (52) 
that 
A,i(s) 
Arr (s) 
’ 108 
Cn ee 
17 17 
=— = (53) 
2/3 (s + 3)(s + 2)(s — 3.3)(s — 2.2) 
1 1937 1.79 DENS 0.99 
-—( g a oH) 
DNV ONSe eo? Se. $= 3.3 s— 2.2 
and hence that 
A,i(s) 3.165 + 8.11 
(2) a 
Aw (s)\/4 273 (s + 3)(s + 2) 


Finally, by substituting (55) and (51) into (42), it is 
found that 


Selo 
(s + 2.2)(s + 3.3) 


Go(s) = 0.53 (56) 


It is interesting to note that if the probability of w(t) 
and v(t) were 1 and 0, respectively, the optimum re- 
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alizable transfer function would be 
0.67 


--——— ; (57) 
s+ 3.67 


Go(s) = 
that if the probabilities of w(¢) and v(t) were 0 and 1, 
respectively, the optimum realizable transfer function 
would be 


0.45 


GES Fae ee 
“) Se 


(58) 
and that if w(¢) and v(t) were equally likely and equally 
important, the optimum realizable transfer function 
would be 

s + 2.39 


Gals), 0.003 , 
(s + 2.16)(s + 3.4) 


CONCLUSIONS 


(59) 


The mean-square error criterion has been generalized 
to obtain the mean amplitude-set-time-weighted error 
criterion. By suitable choice of the weighting functions 
in this criterion, one can accentuate the importance of 
error of specified amplitudes, of error occurring at spec- 
ified times, and of error in processing specified inputs. 
The use of this criterion leads to the synthesis of the 
optimum time-invariant physically realizable system 
for performing the desired task. 

Although the inputs to the system may be either sta- 


- tionary or nonstationary random processes, this crite- 


rion is particularly useful for treatment of nonstationary 
random processes. 

An exact solution for the optimum realizable trans- 
fer function is not obtainable in general. However, in 
certain special cases the exact solution can readily be 
found. Notable among these special cases are those in 
which 1) square of error is used for amplitude weighting 
and 2) the system is a digital system with finite mem- 
ory, or the inputs are stationary and the set and time 
weighting functions are separable. For many cases in 
which an exact solution cannot be found, an approxima- 
tion can be obtained by the use of familiar numerical 
methods. 

The success of synthesis on the basis of the MASTWE 
criterion in the special cases mentioned above is en- 
couraging. Possibilities for future work on this subject 
include consideration of other amplitude-weighting 
functions, of rules for choosing the form of the set-time 
weighting function for specific applications, and of the 
properties of the second-order correlation functions and 
their transforms. 
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A General Performance Index for Analytical 
Design of Control Systems’ 


Z. V. REKASIUSt+ 


Summary—A generally applicable performance index for linear 
feedback systems is proposed. This performance index enables one 
to specify a desired (ideal) response towards which the system is 
optimized. The response of any unity-numerator system can be 
chosen as the ideal response. The coefficients of the performance 
index are determined from the specified ideal response, and the 
procedure of optimization is equivalent to minimization of the nu- 
merical value of this performance index. The procedure for con- 
structing Liapunov functions for linear systems is used to minimize 
the performance index. System optimization is illustrated by means 
of examples. The results indicate that the smaller the numerical 
value of the performance index, the closer the actual system response 
approaches the specified ideal response. 


INTRODUCTION 
EVERAL performance indexes have been proposed 


in the literature for use in connection with the de- 
sign and optimization of linear automatic control 
systems.” 
The ISE performance index, defined as 


I =f ema (1) 


has been used, for example, by Newton, Gould and 
Kaizer* in the analytical design of optimum systems. 
The ISE performance index yields systems that con- 
tain long sustained oscillations. For example, in a sec- 
_ ond-order system the optimum ISE system was found to 
require infinite loop gain and resulted in decaying oscil- 
lations of infinite frequency—certainly a very undesir- 
able situation. The basic weakness of the ISE and other 
similar error-integral type performance indexes is that 
the response of the optimum systems does not follow 
any predictable form; 7.e., the designer does not have 
any a priori knowledge about the desirable (or undesir- 
able) performance characteristics of the optimum sys- 
tem. 
In order that a performance index be generally ap- 
plicable, it not only must reveal the performance char- 


: * Received by the PGAC, December 15, 1960. The research 
leading to this paper was supported by the Air Force Missile Dev. 
Ctr., Holloman Air Force Base, under Contract No. AF 29(600)-1933. 
J. H. Gengelbach was project supervisor. 

+ School of Elec. Engrg., Purdue University, Lafayette, Ind. 

1D. Graham and C. R. Lathrop, “The synthesis of ‘optimum’ 
transient response: criteria and standard forms,” Trans. AIEE, vol. 
72 (Applications and Industry, no. 2), pp. 273-288; November, 1953. 

-- 2YJ. E. Gibson, et al., “Specifications and Data Presentation in 
Linear Control Systems,” Purdue University, Schoolof Elec. Engrg., 
Lafayette, Ind., Rept. No. 1, AF 29(600)-1933; 1959. 

3G. C. Newton, L. A. Gould, and J. F. Kaizer, “Analytical De- 
sign of Linear Feedback Controls,” J. Wiley and Sons, Inc., New 

York, N. Y., pp. 46-50; 1957. 
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acteristics of its optimum systems, but also must enable 
the designer to choose what the desired characteristics 
of the optimum system should be. In some applications, 
such as line voltage regulation, for example, an ex- 
tremely fast response to a step disturbance may be de- 
sirable. In other applications, such as control of an air- 
plane in flight, too fast a response to a step command 
may be unacceptable. 

The automatic control system frequently represents 
only a part (7.e., a subsystem) of an over-all physical 
system (missile, airplane, chemical process, etc.). The 
performance requirements for the control system are 
thus determined by the mission of the over-all system, 
and are not the choice of the designer of the control sub- 
system. Consequently, the desired performance specifi- 
cations of control systems are expressed either graphi- 
cally, as desired response curves, or in the form of dif- 
ferential equations and not in the terms of control-sys- 
tem design criteria (such as damping, phase margin, 
M-peak, bandwidth, etc.). 

The performance index proposed in this paper en- 
ables the designer to select the ideal transient response 
which could be achieved if a sufficient number of sys- 
tem parameters were under the designer’s control (7.e., a 
free-system configuration). This ideal response, ex- 
pressed by a linear homogeneous differential equation, 
corresponds to the absolute minimum value [min min of 
the performance index /. In the practical case of semi- 
free-system configuration, the variable parameters are 
adjusted to yield the minimum value Jpin of this per- 
formance index. The smaller the difference between the 
values of the performance index of the ideal model 
Imin min and the optimum system Jmin, the closer the tran- 
sient response of the optimum system will approach the 
specified ideal response. Hence, the particular perform- 
ance index represents a different philosophy of the an- 
alytical design. The analytical design procedure based 
upon the proposed performance index does not attempt 
to yield a “good” response, but rather it optimizes 
towards a specific transient response selected to suit the 
needs of a particular application of the system. The 
ability to incorporate the desired transient response 
into this performance index makes it a general per- 
formance index for the analytical design of linear con- 
trol systems. 

A simple straightforward procedure of calculating this 
performance index is outlined in the paper. This pro- 
cedure consists of a solution for a set of linear algebraic 
equations. Simultaneous solution of these algebraic 
equations yields the value of performance index in terms 
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of gain and time constants of the actual system. It 
is then a simple matter to calculate the numerical val- 
ues of the free-gain and time-constant parameters for 
the optimum system (t.e., to minimize J). The pro- 
cedure of optimization is illustrated by means of an 
example of a third-order system. 


THE GENERAL PERFORMANCE INDEX 


A performance index which enables one to specify the 
desired response of the optimum system in terms of the 
differential equation describing the response of an ideal 
model was proposed by Aizerman.’ This performance 
index 


60 d” 2 
tS it E frie frat fos forge (") a (2) 
: 


contains the system-error e, its first 2-time derivatives, 
and the constants 7; (c=1, 2, -- - , 2) determined from 
the differential equation of the ideal (=desired) system 
response. It was shown that the simplest case of the 
above performance index 


= if [e? + 7126?|dt (3) 
0 


yields optimum systems whose response approaches the 
response of the first-order model described by the dif- 
ferential equation 


dx 
(eae = (0) (4) 


as I—Inin. Furthermore, the maximum deviation of the 
optimum response (when J=Jnin) from the ideal re- 
sponse (4) is given by the relationship 


per Oran Pos linia min 
Hee 4/ EERE (5) 
PL 


where Ax represents the maximum difference between 
the actual response x(t) of the optimum system (J = Inin) 
and the response of an ideal system as shown in Fig. 1. 
The value of the performance index [=Jmin min repre- 
sents the ideal system obtained by adjusting all the 
parameters of the system to minimize the performance 
imcdextl: (3). 

The importance of (4) is the fact that it enables one 
to interpret the physical significance of the constant 71 
in the definition of this particular performance index (3). 
Thus, while specifying the performance index, one is 
able to select an ideal system which the response of the 
actual system will tend toward as the performance 
index J is minimized. 

The ideal model of the first-order system described 
by (5) is unsatisfactory, however, since it generally does 


4M. A. Aizerman, “Lectures on the Theory of Automatic Con- 
trol,” Gostekizdat, Moscow, USSR, 2nd. ed., pp. 302-320; 1958. (In 
Russian. ) 
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Fig. 1—Ideal response and the region of actual response of Aizer- 
man’s optimum system. (a) System error. (b) System response. 


not give enough flexibility to describe the ideal desired 
response. The performance index 


a { [a? + T17x" + roti? |dt (6) 
0 


yields the ideal model in the form of a second-order sys- 
tem response. To obtain the differential equation de- 
scribing this second-order model, (6) is rewritten as 


=f [e+ vet Fonte + rtalia 
0 


a(o) xe (0) 
aN ie ae 2rit ade ari? f d (x2) 


2x (oo) (00) 


(0) 


nate Naa ere if ada. (7) 


2 (co) 
Evaluating the last three integrals in the above equa- 
tion, one obtains 


T= fo [e+ vet P ek et rtiltdl + Vn Fore (0) 
0 


+ 27o?x(0)%(0) + 722/712 + 272? ¥(0). (8) 


This result is valid, of course, only in asymptotically 
stable systems, 7.e., in systems with 


a( oo) = do) = to) = 0. 


The requirement of asymptotic stability does not repre- 
sent any practical limitations, since it is meaningless to 
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talk about an optimum control system which is either a 
perfect oscillator or which is unstable. 

The ideal system, corresponding to the absolute min- 
imum value Imin min of (8), is described by the equation 


Te ys = 0. (9) 


Comparison of (4) and (9) reveals that the generaliza- 
tion of the performance index of the type of (2) for 
higher-order models is not obvious, and that each higher- 
order case would have to be worked out separately. A 
more serious disadvantage of the performance index (2), 
proposed by Aizerman, is the limitations imposed on the 
ideal model. Thus, for example, (9) requires that the 
ideal model have a damping ratio ¢>0.707. The same 
reasoning shows that the performance index of (2) im- 
poses even more severe restrictions on the choice of 
higher-order ideal models. 

In view of the above limitations, one is prompted to 
look for a more generally applicable performance index. 
One possibility in this direction would be to define the 
performance index as 


oe) k d‘x 
3). Cathy apes 


* dti 


Ja, k<n. (10) 


i=1 


The absolute minimum of this performance index, and 
consequently the optimum system, would be obtained 
when 


dx 
ee peo te C11) 


One may observe, however, that (11) represents the 
characteristic equation (i.e., the denominator of the 
closed-loop transfer function) of the ideal system. Thus, 
the above performance index (10) would select as opti- 
mum any system which has this particular characteris- 
tic equation, regardless of the numerator of the closed- 
loop transfer function. To differentiate among the sys- 
tems that have the same characteristic equation and yet 
differ considerably in their responses due to differences 
in the numerators of their closed-loop transfer func- 
tions, it is necessary that the value of performance in- 
dex depend upon both the characteristic equation and 
the initial conditions of the response of the ideal model. 

A performance index which meets the above require- 
ments and which is generally applicable with respect to 
any stable constant-numerator ideal model is proposed 
in this paper. This performance index is defined as 


~ k a’x 2 5 k d'x 
— 7 . & a ay Gee, 
ae if E z a if Ga ee esas Or 
Ree dix dx Or 
ine k<n— (12 
ob spO ven aan sr} rF =; | n — (12) 


where n is the order of the actual system and & is the 
order of the ideal model. 
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The error «(¢) is defined as the difference between the 
desired value of the steady-state response c,; and the 
actual response of the closed-loop system (Fig. 2) c(t); 
4.€., 


(13) 


x(t) = Cee — (2). 


Fig. 2—Block diagram of a linear feedback control system. 


Expanding the quadratic term in the integrand of the 
above equation, one obtains 


‘ ii eo | dx i > d'x “a 4 
—2? T 1x — Tite = | 
Saal eed MES ae at apometre 
Re <enise CCV) 


If the system is asymptotically stable and if the steady- 
state error is zero, 1.¢., 


dx( 0 ) 
di aghe dtt 


x(90) = 
then (14) is reduced to 


i) k d‘x 2 
n={ Ee Da | dl + 171x?(0) 
0 v 


i=1 


k-1 dix(o) 2 
ae Levies a |: k<n. (15) 
i=l 2 


The absolute minimum Jmin min Of this performance in- 
dex occurs when the integrand of (15) is equal to zero. 
Consequently, (11) represents the characteristic equa- 
tion of the ideal model for the proposed performance 
index (12). The ideal model itself can be represented 
by a closed-loop system with the transfer function 


C(s) ‘i 1 
R(s) TrS* + tp ysP tt. ++ tryst 


(16) 


PROCEDURE OF SYSTEM OPTIMIZATION 


The ideal model, with respect to which the system is 
to be optimized, is described by (11) and (16). Thus, in 
specifying the performance index for a system, one may 
first describe the desired response to a unit step or any 
ether deterministic input in the form 


x t 
c(t) at Gy om 2. Ae a rage) (17) 
i=l fh 3 
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(18) 


Substitution of (18) and its first k-time derivatives 
into (11) yields the constants 7; of the ideal model. If 
the desired response (i.e., the response of the ideal 
model) is specified graphically, one has to find the 
transfer function (16) of the ideal model. To do this, one 
has to find the function c(s) whose inverse Laplace trans- 
form approximates the specified desired response c(t). 
Both numerical and graphical techniques for time do- 
main approximations of transfer functions have beer re- 
ported in the literature.® 

The next step is to determine the particular per- 
formance index J; (12). In order to accomplish this, let 


: ! dx d'x 
a lim Ww as a 
tao J g dt dt* 
Slim Vip) — Vo). (19) 
t—> 0 


In order to evaluate V(t), one may assume it to be of the 
type of the quadratic form 


dix n d* x dix 
= 2 . 
V ie Daveae Saat aks > Leas apen ar (20) 
From (19) it is apparent that 
W As (21) 
Se 


Thus, in order to calculate W, one has to differentiate the 
function V of (20) with respect to time, and then re- 
place d"x/di” by the lower-order derivatives of x, utiliz- 
ing the differential equation describing the transient 
actuating error signal of the actual system, 7.e., utilizing 
the characteristic equation of the actual system. Let 
the characteristic equation of the actual system be 


d™1% 


d"%, ie 4 
din n—1 dro 


dx 


This procedure yields the expression for W of the form 


ia Ayqyx? 3 Aye a3 35 Si 


qa v=2 Jot 


ge: di-1x¢ 


hit ie ce 


Equating the constants A ;; of (23) with the correspond- 
ing terms of the integrand of (12), one obtains a set of 


nt (n—1)+(v—2)+---41 


linear algebraic equations containing all aj,;'s. Solving 
these equations for the constants a;; and substituting 
into (20), one obtains an expression for the function V. 


See, e.g., J. E. Storer, “Passive Network Synthesis,” McGraw- 
Hill Book Co.; Inc., pp. 303- SSE 959! 
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One may note, however, that for asymptotically stable 
systems 


= 4(c0) = (24) 


4 co) = 


and consequently, 


t(oo) = ++ 


lim V (é) "= 


| oe a) 


(25) 


Hence, the performance index J; can be expressed as 


Thus, to calculate the numerical value of J;, one sub- 
stitutes the initial values of x and its time derivatives 
into the expression for the V function. 

It is important to note that both the ideal and the 
actual systems must be stable [7.e., (24) must be satis- 
fied | in order that the results of the optimization pro- 
cedure be valid. Otherwise, the procedure may yield 
seemingly reasonable—though incorrect—answers. The 
procedure used to evaluate the performance index J; 
in this paper is identical to the procedure of construct- 
ing Liapunov’s functions for linear autonomous sys- 
tems.° 

Hence, one may use Liapunov’s stability theorem 
and prove that the actual system is stable by proving 
that the function V (20) is negative definite and W (21) is 
positive semidefinite. An alternate approach would be 
to apply the Routh-Hurwitz test to the actual system. 

The procedure of optimization will be illustrated by 
means of examples. 


Example 1 


Consider the closed-loop system shown in Fig. 2 with 
the open-loop transfer functions 


Ree 


and H(s)=1. Let the ideal-model response be specified 
as 


ite ene =), 


Comparison of the above equation with (11) yields 
the following values for the constants 7 


TRO 1 
and 
i De 


Hence, from (12) the performance index becomes 


I= if [2 732? + 722? + radi] de 
0 
os f [x? + 4a? + a + 2xa]de 
0 


° I. G. Malkin, “Theory of Stability of Motion,” AEC O k Ri 
Tenn., Translation No. 3352, pp. 37-61; 1959. » Oak Ridge, 
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For this example (7 = 3) the V function (20) is 
V = 44x? a Qy9XX + A43XX _ Qoox a Qo3xXX a 33%7. 


Differentiation of the above equation with respect to 
time yields 


dV 
aa = W = 2ayxe + aor + ayok? + aygaX + aygcti: 
te 2A 20XK a A23KX _ do3h? — 2a33XX. 
The closed-loop transfer function for this system is 


CG k k 
S+2°+s4+hk 


R si+s?+k 
Thus, the system characteristic equation is 
GD we ke = 0) 


Solving this equation for x and substituting into the 
expression for dV /dt, one obtains 


dV 
dt 


H 


W = (— kay3)x? == (2ay1 Ey ae kao3) xx 


a3 (d12 a 2413 = 2ha33) xX = (di. — 
+ (a13 + 2d22 — 2a23 — 233) ¢% + (do3 — 4033)%?. 


Comparing this with the integrand of J2, one may write 
— kay = di a5 2013 rs 2ka33 = Me 
kao => 0; 


413 + 2d22 — 2a23 — 2433 = 0. 


G12 — A23 = 4; 2041 03 — 
d23 — 4433 = if 


Simultaneous solution of the above equations yields 


EPP 4p or 2 reaver? 
in = ) LOL, = cee 
2(k? — 2k) p= 2p 

5k? — 8k + 8 w+ 4k 

2G eee ae cp gue) separ ena 
eS ea os Wet | 
pera fe? 25h deny mee: 


Note that, for this system, the initial conditions due to 
a unit step input are 


a(o) = 1 
£(o) = 0 
#(0) = 0. 


Hence, from (19) and (25) 

ket 4b + 3k +2 
2(k? — 2k) 

8 + 4k? + 3k +2 
ives 


Ip = V(o) a ER x°(0) 


a 


The optimum system will, obviously, correspond to 
the minimum value of the performance index J, This 


Pa 


Ss are = ~ sf 


Rekasius: A General Performance Index for Analytical Design Control Systems 


221 
minimum value occurs when k=0.43; thus, 
US in = GAOeY 


The numerical value of the performance index for the 
ideal model is obtained by substituting (11) into (14). 
This procedure yields 


Tests min a 2.00. 


The response of this optimum system is shown in Fig. 3. 


O:5 
Ideal 


Optimum 


(|Example |) 
(|Example 2) 


Optimum 


1) 5 10 15 t 


Fig. 3—Ideal response and the responses of optimum systems of 
Example 1 and Example 2. 


Example 2 

The preceding example illustrated the procedure of 
optimization of a system with only one variable param- 
eter. Much better results can be achieved with more 
free parameters. To illustrate this point, consider the 
system with 


si 0.43 
PLEO Ts), 
anced (s)==1: 


By the same procedure used in Example 1, one finds 
that 


G(s) Meee Tato, 


0.4377 > 180 de4--1,38 


Ib = — Vo) = 
(0) 0.49T + 0.86 


With the constraint on 7 (0.5<7<), the minimum 
value of the performance index J: occurs at 


Je Ay 
then 
Ere 


The response corresponding to this optimum system is 
shown in Fig. 3. 

The preceding two examples illustrate the procedure 
of system optimization by means of the proposed per- 
formance index. Fig. 3 indicates clearly that the lower 
the value of the performance index, the closer the opti- 
mum system response approaches the specified ideal 


999 


response. Without the constraint on the open-loop 
time-constant 7, the second example would yield an 
unstable “optimum” system with 7’<0. This shows the 
need to check the stability of the final system, or to 
constrain the parameter values in such a way as to as- 
sure a stable optimum system. 


CONCLUSIONS 


The proposed performance index can be used in a true 
synthesis procedure of automatic control systems. The 
importance of the particular performance index pro- 
posed in this paper is that it enables one to synthesize 
an optimum system to external time-domain specifica- 
tions set up by the user, rather than to some artificial 
specifications (such as phase margin) chosen by the 
servo designer. 

The examples illustrating the procedure of optimiza- 
tion by means of this performance index, for simplicity, 
were based upon specifications of system transient re- 
sponse due to step inputs. The procedure of optimiza- 


IRE TRANSACTIONS ON AUTOMATIC CONTROL 


May 


tion to specified transient response to other deterministic 
inputs such as ramp, sinusoidal, etc., can be carried out 
in exactly the same manner; the only difference in such 
cases would be the change in initial values of response 
and its time derivatives to be substituted in the ex- 
pression for the performance index. 

A drawback common to the performance index pro- 
posed in this paper, and all other integral.of error type 
performance indexes, is that the procedures of evaluat- 
ing these performance indexes sometimes fail to reveal 
that the system is unstable and thus yield seemingly 
reasonable—though erroneous—results. A possibility of 
incorporating Routh-Hurwitz conditions into the pro- 
cedure of system optimization is investigated. How- 
ever, no results in this direction can be reported at the 
present time. 
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Stability of Servomechanisms with Friction and 
Stiction in the Output Element” 


P. K. BOHACEK? ann F. B. TUTEURY, MEMBER, IRE 


Summary—Servomechanisms with friction in the output ele- 
ment are often observed to oscillate, even though the Bode diagram 
indicates stability. This paper investigates the conditions for this in- 
stability and the type of oscillation that can occur. It finds that an 
overdamped system with a lag equalizer is stable if L<2C/C—1, 
where L is the lag ratio and C=static friction +Coulomb friction; 
with a lag-lead equalizer it is stable if 


iB, 7X0; 
< ’ 
fea/05 C= 1 
where a/b is the ratio of the two zeros of the network. For under- 
damped systems, the same analysis may be carried out, resulting in 


only slightly more complicated expressions. Experimental results 
that correlate with the theory are also included. 


I. INTRODUCTION 
j | YHE servomechanism studied in this paper is a 


single integration, second-order system.! All com- 
ponents are linear, except the output power ele- 


* Received by the PGAC, December 14, 1960; revised manu- 
script received, March 14, 1961. 

+ Elec. Engrg. Dept., Yale University, New Haven, Conn. 

1 J. L. Bower and P. M. Schultheiss, “Introduction to the Design 
of Servomechanisms,” John Wiley and Sons, Inc., New York, N. Y.; 
1958. 


ment, which has static friction?" (stiction) and coulomb 
friction. The block diagram for this system is shown 
in Figs 1. 

The output element can be represented by the non- 
linear differential equation 


a’ dé 


B—= = 
i Giles, ! () 


uf 


where J and B are the parameters, such as inertia and 
viscous friction in a motor. The function f, representing 
the static and coulomb friction, is a complicated func- 
tion of the output velocity and the applied force. Its 
nature is indicated in Fig. 2, as a function of d@/dt. 

The box A represents all the gain of the circuit and is 
assumed to have a greater bandwidth than the output 
element. 


Vieeowsandeee ve Schultheiss, “Static and sliding friction in 
ee systems,” J. Appl. Phys., vol. 24, pp. 1210-1217; Septem- 
er, : 
°R. L. Moruzzi and F. B. Tuteur, “Nonlinear servomechanisms 
of limited dynamic range,” Trans. AIEE, vol. 79 (Applications and 
Industry, no. 51), pp. 314-320; November, 1960. 
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Fig. 1—Block diagram. 


f S=static friction 
F=coulomb friction 


Fig. 2—Static and dynamic friction. 


A system of this type often exhibits instability when 
equalized with a lag or lag-lead equalizer. This insta- 
bility occurs even though the Bode diagram indicates 
stability. The Bode diagram is usually measured so as 
to make friction negligible (for instance at high ampli- 
tudes). The oscillations observed are usually of a re- 
laxation type and are of low amplitude and frequency. 
They are usually at a frequency below the crossover fre- 
quency. 

A piecewise linear analysis‘ is used to find the condi- 
tion for oscillation for a lag and a lag-lead equalizer. 
This is done for the case where the system is under- 
damped and also where it is overdamped. 

By this method it is found that for the under-damped 
case, stability is achieved if 


rg G 
ve 
Pash 4 


, (2) 


where C=static friction+coulomb friction and a and b 
are the two zeros of the equalizer. A similar expression 
is found for the underdamped case. 


II]. ANALYsIS WITH LAG EQUALIZER 
A. Overdamped System 


Consider a lag network with the transfer function of 
the form 


(3) 


This network has an assymptotic Bode diagram as 
sketched in Fig. 3. This type of network has a gain of 


one for low frequencies and a gain c/a for high frequen- 


cies. When a step function of unit amplitude is applied 
to such a network, the resulting output is sketched in 


Fig. 4. 


pe WJ: Cunningham, “Introduction to Nonlinear Anlaysis,” 
McGraw-Hill Book Co., Inc., New York, N , Y.,pp. 66-69 ; 1958. 
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log-log scale 
lH 


alo 


Cc a frequency 


Fig. 3—Bode diagram of lag equalizer. 


Fig. 4—Step function response of a lag network. 


This type of response can be thought of as coming 
from a network that initially has a gain of c/a and whose 
gain slowly increases to 1. Applying a step function to 
this hypothetical network would give the same re- 
sponse as in Fig. 4. The lag equalizer can then be re- 
placed by this type of time varying network. 

Let it be assumed that R, the input, changes very 
slowly. Initially the whole system was at rest and 
e=y=0=0. As R changes, so does e and y changes A 
times faster. The output @ cannot change yet, since y 
is not large enough to overcome the stiction force, S. 
Eventually, however, the value of y will overcome the 
stiction S and the output will start to move. Just before 
this happens, the following conditions hold: 


y=S= Ae 
5 
C= — 
A 
4 
R=— 
A 
6 = 0. 


For any rapid motion of 0, the gain of G will be 
(c/a)A=A/L, where L can be identified as the lag 
ratio. That means that the variation in y, that is, Ay 
will be 


It has been assumed that R changes so slowly, that 
during the subsequent motion of 6, it remains constant 
at R=S/A. Then (1) becomes 


(ise ela Pea enpear pie (4) 
dt? Fe ha Se L 
or 
Fee ag hs ay FG 1) (5) 
dt? Gian 


where C=S/F. 


994 


hon hoy 


Laplace transforming both sides gives 
, A GE, 
J0s? + Bés 4 7 (he (6) 
D S 


where F and C are constants, and where 6=6(s) is the 
Laplace transform of 0. 
Solving for 6 


(DE Aly) 


= ji (7) 
s(s + Bs + =) 
IL, 
B 
5 api 
eet _ 1) L uf (8) 
Soe : r coeeree 
SS pipe ari ear 
Uy: ee 


Retransforming into the time domain, @(t) becomes 


a) == (C - vfr-(F 


B 
Sera 
pe 
+e 
1 B 
n(n aera 


Sia) | © 
Tey, ‘YO SHE PSE 

This equation holds for a short time only, while the 
gain of G is essentially A. The varying gain of G in- 
creases as e~°', while the response of the system is lim- 
ited by the time constant of the output element. In 
most designs the time constant of the equalizer is much 
greater than the time constant of the system. Hence the 
system will, to a good approximation, have completed 
its motion before e~** has changed much. 

Eq. (9) shows that the time response of 6(¢) will be 
an exponential, with the final value (LF’/A)(C—1). If this 
distance is larger than 2.S/A, then it might be thought 
that the system would be unstable, since @ would over- 
shoot the desired location by an amount greater than 
its original deviation S/A. 

This condition for instability gives 


LF US) 
=—(C-—1)>—- 10 
5 ( ) > (10) 
- Since S=CF, the condition for instability becomes 
pile 
1S. . (11) 
c-1 


This condition, however, is not quite sufficient for os- 
cillation. Just before @ started to move, y was equal to S 
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and CF. At that time e was S/A. Since 6 moved the dis- 
tance (LF/A)(C—1), then at the end of this motion 


(12) 


Then y will be 


A 
=S——0o=F. 
Z if 


But since eventually y becomes Ae, y will approach the 
quantity 


FIL. — C4 'e], 


When condition (11) is satisfied, this quantity is smaller 
than —CF. Thus at some time y will be equal to — CF. 
Then the conditions will be similar to those just before 
6 started to move. 

The equation of motion will then be similar to (5); 


‘ Zs. 
Js? + Bos + —6 = F(1 — C). (13) 


Solving this equation in the identical manner of (5) 
gives that @ moves exponentially the distance 
—(LF/A)(C—1). This will bring @ back to its original 
starting position at @=0. Then e=S/A and y will ap- 
proach S. But it will reach this only after an infinite 
time has passed. Thus it seems that the system will 
settle down after one cycle. 

If it is assumed that for some reason, when @ first 
moved, it did not move quite far enough, 7.e., it moved 
the distance (LF/A)(C—1) —1, where 7>0, then during 
the second half of the firstcycle, if moves (LF/A)(C—1), 
it will come to rest at 9=7. Then e=(S/A)+iand y will 
approach S+ Az. Thus after some finite time, y will be 
equal to S and @ will move again. From then on the 
oscillations will continue, even if @ moves only 
(LF/A)(C—1) every time. Thus it can be seen that once 
started properly, the oscillations will continue indefi- 
nitely. The amplitude of the oscillations will also be 
constant. 

It can be seen that the two halves of the cycle need 
not be equally long. In fact it seems probable that they 
will not be of equal duration. 

Since the stiction and friction of most elements is 
somewhat random, it may be expected that the dura- 
tion of each half cycle will change. If the stiction should 
change enough, it may also be possible that the oscilla- 
tions would stop. 

The sketches of the expected waveforms from the 
above analysis are shown in Fig. 5. 


ee 
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Fig. 5—Waveforms of @(t), e(t), and y(t). 


B. Underdamped System 
If the system is underdamped, then in (9) 


pipe A (14) 
4]? al 
and therefore 
LF 7 bs e Btls 
a(t) =— (C — 1)} 1 —- \/ a 
) A ( ) Ve LS 4/ ste Be 
ea 4]? 
A B? B 
“COS (: — — — — tan! ALS) 
EE: 4]? A g 
2I — — — 
LS 4 J? 


This solution holds only up to the first maximum, 
when @ stops for the first time and tries to reverse. When 
the velocity of # reverses, the friction reverses. Hence, 
6 does not start to move again until y is large enough to 
overcome the stiction, S. 

It must then be found where @ stops. The time when 
this happens can be found by solving d6(t)/dt=0 for ¢. 
This gives that the time for the first maximum is 


T 
bg = * 
A BP 
Le AS 2 


Substituting this value of t=f,, into (15), Amax becomes 


(tm) a Omax 


-~(-» 1+ exp — bs (16) 
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Then the condition for instability becomes Ona. > (2S/A). 
This is equivalent to 


( 
Di exp 


ve NC 
———_—_——_—] > — (17) 
/— ' C= i 
pp) 
This condition is the same as in Section II-A, except for 
the factor 


1 ) 
AAT J 
LB? 


1 + exp — — 


This factor varies from 1 to 2, depending on the 
damping, as long as the system is underdamped, 1.e., 
GAT L D2) te> 0, ae qom(d 1) ereduces™ .tommL ly stor 
(4A J/LB?) —1=0. 


III. ANaLysis witH Lac-LEAD EQUALIZER 


A. Overdamped System 
The step function response of a lag-lead equalizer with 
the transfer function 


(s + a)(s + 8) 


H(s) = h banca 1 
(s) Gama a where a C (18) 
is given by 
6+ G0 14 
et) = 1+ oe Re ee (e~*# — ¢-4), (19) 
Py 


The waveform of a typical step function response and 
the assymptotic Bode diagram of a lag-lead network are 
sketched in Fig. 6. 


log-log scale 


—— ae 
G,_ <a b d 
frequency 


Fig. 6—Step-function response and Bode diagram of lag-lead network. 


Comparing this response to that of the lag network, 
shown in Fig. 4, it may be noticed that they are very 
similar, except for the sharp spike that the lag-lead re- 
sponse has. 

A lag-lead network may also be thought of as a cir- 
cuit whose gain is initially low and increases with time. 
In addition the short spike must be considered. This 
may be treated as a delta function. 

Disregarding the delta function for the moment, the 
initial gain of the hypothetical lag-lead network must 
be equal to the minimum value that the response reaches 
after the sharp spike. To find this value, the step func- 
tion response must be differentiated and set equal to 0. 


9296 


From this it is found that the minimum occurs at 


= — |1/(d—c) | log c/d. Therefore 


C + a pa b == i) ( C Ni ( G ia 
He d d 
Since c<d 
Gade C b+a EVO C 
Sea) | 
d d d d d 


For c/d in the range of 0.001 to 0.01, which is a very 
good approximation to the values encountered: 


ge Vole C 

(=) lst oe, Uf a 

d a 
~(-+4)(1 57) 45.74 
at eer ( es baat 


where L=d/b=a/c. 
Since (c/d)<1 


(se) lee 
€min = = ‘ 
vee d LOE eh 


The instantaneous gain of the lag network was found 
to be 1/L. The instantaneous gain of the lag-lead net- 
work is greater by a factor (1+a/b). 

This result may be substituted into (9) to get the re- 
sponse with a lag-lead equalizer. The total distance that 
6 moves is then 


€min = 1 


Then 


(20) 


LP 


Instability occurs then if 


(Cap 


(21) 
ie 
b 


Now the effect of the delta function must be consid- 
ered. First of all it must be examined if it is a good as- 
sumption to say that the short spike may be thought 
of as a delta function. 

In most applications, the equalizer is designed in 
such a manner, that the highest pole as s=—d is ata 
frequency above the major time constants of the sys- 
tem. Since the spike decays with the time constant of 
1/d, it will have decayed before the system has had 
much time to respond. Thus the assumption that the 
spike may be handled as a delta function of the same 
area is a good one. 

To find the estimate of the area under the care the 
difference between the lag-lead response and the lag 
step function response may be taken. This difference 
Ae is 
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Since cKd and a<d, 


Integrating this gives that the area under the spike is 


ad—b 1 1 
De -—(1-=). 
a d b 
Since the system is linear, the effect of the delta 


function may be computed separately. Thus the sys- 
tem equation becomes 


r - a 
Mapai enone vas 


Solving for 0 gives 
D [ e i/ B? S 
= expe Se 
/ B®? — 4AT/L Dy ay? LT 


Ss (=4 be ay (22) 
Doe Ny SY eye oar has 

Thus the delta function does not change the final 
value of 6, and hence it does not affect the stability of 
the system. 

Thus (21) gives the stability criterion for the lag- 
lead equalizer. Since for the lag equalizer 0 is infinite, 
(21) becomes identical to (11), the stability criterion 
for the lag-network. Therefore (21) holds for both types 
of equalizers. 

Fig. 7 shows the stable and unstable regions for vari- 
ous values of C and L’. 


A(t) 
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Fig. 7—Stable and unstable regions. 


B. Underdamped System 


As in the case of the lag network in Section II-B, the 
lag-lead network case may be analyzed for the under- 
damped case. In a similar manner the first maximum 
must be found. Since the same equations hold, the solu- 
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tion must be the same. Hence the maximum increases 
by the factor 


f 
1+ exp — 


TT 
4AJ 
: — 1 
eB? 
in the underdamped case. Thus the system is unstable 
if 


where (44 //LB?)—1>0 from (14). 


IV. EXPERIMENTAL RESULTS 


A system was built that satisfied the description in 
Section I. It consisted of a vane-type pneumatic motor, 
driven by a three-land valve. There was friction and 
stiction in both the valve and the motor, but that of the 
motor was much greater. 

Lag-lead equalizers with different values of L/(1+a/b) 
were built. These values were 4, 7, 10 and 14. The value 
of C was found to be somewhere between 1.4 and 1.6. 
Hence from the above analysis the system should be 
unstable for values of L’ higher than 6.2 +0.8. The ex- 
perimental results confirmed this prediction. When L’ 
was 10 or 14, the system was definitely unstable and the 
waveforms observed coincided closely to those of Fig. 5. 
For L’=4, the system was definitely stable. But when 
L' was 7, the system appeared on the verge of insta- 
bility. Fig. 8 shows the experimental waveshapes for 
Wee Te 
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Fig. 8—Experimental results. (a) Waveform of valve position +(t). 
(b) Waveform of output position 6(f). 


V. CONCLUSIONS 


In designing a servomechanism where friction and 
stiction are present, the value of C=S/F must first be 
found. Then from the expression 2C/C—1 the largest 
value of 


Tv 
= 
—1 
LB? 
1+ a/b 


can be found. The design of the equalizer must then be 
made to satisfy the stability condition. Since very often 
it may be difficult to determine the quantity 


( 
Le aexpe 


Tv 
yee ; , 
1 Be 
it may be assumed that very little damping is present. 
In that case the system will be stable if 
2G BE 
> 5 
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This will take care of the worst possible case. 
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Sensitivity Considerations for ‘Time-Varying 
Sampled-Data Feedback Systems” 


J. B. CRUZ, Jr.t, MEMBER, IRE 


Summary—A synthesis procedure for linear time-varying sam- 
pled-data feedback systems is described. Just as in the continuous 
system case, one of the advantages of feedback in a sampled-data 
system is that it can potentially reduce the effect of plant variations 
on the system performance. To a certain extent, load disturbance 
and instrument noise may be simultaneously reduced also. A time- 
domain sensitivity matrix is defined and used in the design of the 
digital compensators for prescribed insensitivity of the system to 
plant variation. In addition, two optimization criteria are presented 
for the design of these compensators when load disturbance and in- 
strument noise have to be reduced as well. The procedure is also 
applicable to time-invariant sampled-data systems. 


INTRODUCTION 
7 | YHE USE of sensitivity functions in the design of 


linear and continuous feedback systems is well 

known.!* In this paper, the usefulness of the sensi- 
tivity concept is extended to the case where the signals 
in the feedback system are sampled, and where some or 
all of the components may vary with time. A mechani- 
cal system with some mass which decreases with time 
is an example of a time-varying system. 

Consider the block diagram shown in Fig. 1 where 
-P is the time-varying plant, G is the feed-forward 
digital compensator, and H is the feedback digital 
compensator.‘ It is assumed that signal can reach the 
output only through the plant. Furthermore, there is 
noise N,; representing load or output disturbance, and 
feedback can be obtained only by allowing additional 
contamination NV, representing feedback instrumenta- 
tion noise. This structure has essentially two degrees of 
freedom,’ and will be sufficient for illustrating the role 
of sensitivity in design procedures. The problem is to 
synthesize the digital compensators G and H given: 
1) characteristics of the time-varying plant together 
with expected variations from the nominal, 2) desired 


* Received by the PGAC, December 14, 1960; revised manuscript 
received, March 13, 1961. This research was supported jointly by the 
Dept. of the Army (Signal Corps and Ordnance Corps), Dept. of 
the Navy (Office of Naval Research), and the Dept. of the AF 
(Office of Scientific Research, Air Res. and Dev. Command) under 
Signal Corps Contract_No. DA-36-039-SC-85122 with the Coordi- 
nated Science Lab., University of Illinois, Urbana. 

{ Elec. Engrg. Dept. and Coordinated Science Lab., University of 
Illinois, Urbana, Ill. 

1H. W. Bode, “Network Analysis and Feedback Amplifier De- 
sign,” D. Van Nostrand Co., Inc., New York, N. Y.; 1945. 

2 J]. G. Truxal and I. M. Horowitz, “Sensitivity considerations in 
active network synthesis,” Proc. 2nd Midwest Symp. on Circuit 
Theory, pp. 6-1 to 6-11; December 1956. 

37. M. Horowitz, “Fundamental theory of automatic linear 
feedback control systems,” IRE Trans. on AUTOMATIC CONTROL, 
vol. AC-4, pp. 5-19; December, 1959. 

4J. T. Tou, “Digital and Sampled-Data Control Systems,” Mc- 
Graw-Hill Publishing Co., Inc., New York, N. Y.; 1959. 


over-all input-output characteristic, 3) noise N; and 
Nz, and 4) an optimization criterion. 

The characterization for the various components in 
the system that is used in this paper is Friedland’s 
transmission matrix.® The transmission matrix is essen- 
tially the mathematical transformation which relates 
a sequence of input signal values at the sampling in- 
stants to a sequence of output signal values at the 
sampling instants when the system is linear. The com- 
ponents are assumed to be preceded and followed by 
sampling switches which are not necessarily ideal im- 
pulse modulators.‘ If «(¢) is the input to the sampling 
switch and x*(t) is the output of the sampling switch, 
then the transfer characteristic of the switch is as- 
sumed to be 


k=[t/T] 


>> x(kT)s(t — kT), (1) 


k=0 


so Pt 


where 7 is the uniform sampling interval, [t/7] is the 
largest integer in ¢/7, and s(t—k7) is the output pulse 
of the switch when the input is a unit amplitude sample 
at t=hkT. 

If the response of a physical linear system H, such as 
that in Fig. 2, due to an input s(t—T) is h(t, 7), then it 


Fig. 1—A digital feedback control system with two degrees of free- 
dom and with load disturbance and feedback instrumentation 
noise shown. 


x fea te he | VS ho) CaS 
ery 
! ! 1 ' 
(Ss) [ype 
Fig. 2—Block diagram for system with samplers at input 
and at output. 


5B. Friedland, “A technique for the analysis of time-varying 
sampled-data systems,” Trans. AITEE, (A pplications and agen 
vol. 75, pt. 2, pp. 407-414; January, 1957. 
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follows from the defining property of linear systems 
that the output y(¢) due to an input «*(¢) given by (1) is 


k=[t/T] 


D> «(kT)h(t, RT). (2) 


k=0 


y(t) = 


If only sampling instants are of interest, we may write 
(2) in matrix form as 


ee ee 0) 0 
y(T) BLO) Sen 7) 


} x27) =| h(2T,0) A(2T, T) 
The matrix 
h(0, 0) 0 
LO) AT) 


H =| h(2T,0) n(2T, T) 


is Friedland’s transmission matrix of the linear system 
consisting of the input sampling switch and the system 
H. From the switch characteristic of (1) the output y*(¢) 
is related to y(t) by 


y*(0) s(0) 0 
Peale sity s(0) 0: 
Sls27) stT) -s(0) 0 se 
y(0) 
ih 
y(T) } iB 


which is the matrix analog of (1). From (3) and (5) we 
have the matrix equation 


[s] [A] [x]. (6) 


All the components will always be preceded by input 
sampling switches. In many practical cases the pulse 
s(t—r) is very narrow and hold circuits‘ are inserted 
between the samplers and the following continuous type 
system. The hold circuit may be considered part of the 
switch or part of the continuous system. 

Fig. 3 (next page) shows the surface A(t, 7) and the 
sample points on the surface which represent the ele- 
ments of the transmission matrix. For ¢<7, h(t, 7) =0 
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because of physical realizability condition. Clearly, for 
a physically realizable transmission matrix H= [h,;|, 


hi; = (0) i@e 7@ < ah (7) 
so that H must be a triangular matrix. If hij=Aisejre 
for all 7, 7 and k which are integers, then we say that the 


system is time-invariant. Note that from the transmis- 


x(0) 
0 cata aT) 
HQT 27) SORA (3) 
0 
W275 27) 0 ae (4) 


sion matrix of the sampler as in (5), the sampler is 
clearly time-invariant. 

Let the plant transmission matrix be denoted by P, 
that of the feedforward compensator by G, that of the 
feedback compensator by H, that of the desired over-all 
system by Fy, and that of the actual over-all system by 
F. Let Y denote the output signal vector 

y(0) 
y(T) 


Vet 2 Lye (8) 


X the input signal vector, 
x(0) 
«(T) 


X =] «(27) |; (9) 


N, the load disturbance noise vector, 
nx(0) 
nmi(T) 
m(2T) |; 


N= (10) 


h(t) 


Fig. 3—Impulse response surface h(¢, 7) and sample points repre- 
senting the elements of the transmission matrix. 


and WN, the feedback instrumentation noise vector 


Bee 
nT) 


Nz = (11) 


From Fig. 1, assuming V;= N2=0 for the moment, the 
error vector £ is 


E=X— HY. (12) 
The plant input vector is 
Mech GX — GHY, (13) 
and the output Y is 
Y = PM = PGX — PGHY (14) 
or 
Va APCID-6PCX, (15) 
provided [+ PGH is nonsingular. Since by definition 
aX, Vitor? Ny = N=. 0, (16) 
then 
Fo= UT + PGH) PG. (17) 
Similarly, assuming X = N2=0, and Ni+40, 
i eae (18) 
M = — GHY, (19) 
and 
Y= PM+N,= —~PGHY + N,, (20) 
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or 
Y = (1+ PGH)NM,, (21) 


provided J+ PGH is nonsingular. The transmission to 
the output due to J; is defined as Fy,, 7.e., 


Y=Fy,N, for X = N.=0, (22) 
so that 
Fy, = (I + PGH)-. (23) 
For 
N,=X =0, N»2 # 0, 
we find 
E.= — H(Y +2), (24) 
M = GE= — GHY — GHN,, (25) 
and 
Y = PM = — PGHY — PGHN,, (26) 
or 
Y = — (1+ PGH)“ PGHN,, (27) 


provided J+ PG4H is nonsingular. Again the transmis- 
sion to the output due to Nz is defined as Fy2 and from 
(27), 


Fy, = — (1 + PGH)" PG. (28) 
If X, Ni, and N2 are all present, 
Fm Ry Vey es (29) 


which is of course a consequence of the superposition 
property of linear systems. 


THE SENSITIVITY MATRIX 


Let the actual transmission matrices be denoted by 
the subscript 2, the nominal ones without subscript, 
AP the deviation between P: and P, and AF the result- 
ing deviation between F; and F as caused by the devia- 
tiOn Mn) 4.6, 


P, =.P + AP, 


(30) 
(31) 


AP is usually the tolerance on P. The sensitivity ma- 
trix will be defined as 


S = FF, (32) 


where /~' is the inverse of F: provided F2 is nonsingu- 
lar. This sensitivity matrix has the same form as 
Horowitz’s® sensitivity matrix for linear time-invariant 
continuous systems, defined in the frequency domain. 
Although physically the matrices in Horowitz's paper 
have an entirely different meaning compared to the 


6]. M. Horowitz, “Synthesis of linear, multivariable feedback 
control systems,” IRE Trans. on AUTOMATIC CONTROL, vol. AC-5, 
pp. 94-105; June, 1960. 
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transmission matrices, the algebra is exactly the same. 
A further generalization of the sensitivity definition in 
(32) is obtained, if general operators are used instead of 
transmission matrices.? 

It can easily be shown that in addition to (17), F is 
also expressible as8 


F = PG(I + HPG)-. (33) 
Similarly,? 
wie AP = GPs tAPPF, (34) 
Replacing AP by P.—P, 
S =G>Py\(P, — P)P-F 
hs sr Kk — GPs PP OP 
= Gera — Po )F, (35) 


If P, Pz, F, and S are specified, G must be synthesized 
as 


= (P 3 — PP.) FS. (36) 
Similarly, from (17), H must be synthesized as 
Bi= f4— (PG). (37) 


Eqs. (36) and (37) are the basic design equations for 
the digital feed-forward and feedback compensators if 
no noise specifications are involved. That is, for given 
AP and P, if Fand S are specified, the synthesis can be 
done exactly because there are two degrees of free- 
dom. If in addition Fy, and Fy, are specified, in general 
an exact solution is not possible. Some compromise de- 
sign must be chosen, and in the next section, we will 
formulate criteria for optimization. First let us show 
that the requirements that Fy, and Fy, have arbi- 
trarily small elements are contradictory. From (23), 


Fy, = F(PG)"', (38) 
and from (28), 
Fy, = — FH = — Fy,PGH. (39) 
But from (23) again, 
PGH = fy" = 1, (40) 
so that (39) becomes 
Py = — ly (Py, ) — 1) = Fay il, (41) 


Note from (41) that if the elements of My, are made 
much smaller than 1, then Fy, will be essentially a 
unity transmission matrix. Forcing the elements of Fy, 
to be very small will result in My, being essentially a 
unit matrix. Thus small Fy, and small Fy, are contra- 
dictory. On the other hand, if Fy, is not important, 


7 J. B. Cruz, Jr., “Some techniques for the analysis and synthesis 
of nonstationary networks,” 1961 IRE INTERNATIONAL CONVENTION 
REcoRD, pt. 4, to be published. 

8 Pioroia! op. cit., Eq. (8) with T replaced by F. 

“9 Thid., Eq. (13). 
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then a design based on forcing S to have small elements 
is compatible with forcing Fy, to have small elements. 
From (35) and (38), both the Fy, and S matrices may 
have as small elements as desired by simply choosing 
G to have large elements. Thus G can be chosen to have 
large enough elements so that the resulting elements in 
S and Fy, are all less than those specified. 


OPTIMIZATION CRITERIA 


In this section, two performance criteria are pre- 
sented, and designs based on minimizing the associated 
performance functions are defined as optimum. The 
complexity of the design procedure and amount of cal- 
culation required will usually depend on the choice of a 
performance function. 

Suppose the noise vectors Ni and Np» are appreciable 
and it is desired to reduce their effects at the output. 
It was shown in the last section that Fy, and Fy, can- 
not be simultaneously reduced arbitrarily. A suitable 
compromise performance function is 


C = K\|Fy,||? + ||Fw,| 


°; (42) 


where C is the performance function, K is a constant 
equal to the ratio of noise energy in source J to that in 
source No, || Fy,||? is the square of the Euclidean norm 
of matrix Fy,, and similarly, || Fl? is the square of the 
Euclidean norm of matrix Fy,. The Euclidean norm of 
a matrix is defined as 


(43) 


All = (x Lae) 


i=1 j=1 


which is the square root of the sum of the squares of all 
its elements. Let the elements of the matrices Fy, and 
Fy, be denoted by y,fi; and y,fi; respectively where 7 
indicates the row location and 7 the column location. 
From (41) and (43), (42) becomes 


N N 
C = K|Fy,||? + ||Fw, — 1? = K DOD fi? 


tle j=1 


(44) 


NNN N 

a | IOS ilar pean 1. 
iy i 

The problem now is to choose the elements of the Fy, 

matrix such that C is minimized. Eq. (44) may be 

further written as 


CZK Oe DS avifs 


ij 
N 


+ >) [Kw fi? + Gnfis — 1)?]. 


i=1 


(45) 


It is clear that for 747, the optimum choice for y, fi 
is zero, 1.€., 


Nata — 0, for (46) 
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Only the main diagonal elements remain to be deter- 
mined. Differentiating C with respect to f;; and equat- 
ing to zero, 


2K, fii =e 2a fii 1) = 0 (47) 


or 


ee ore = Des WN. (48) 


WA spe = 
TR ah 
From (38), the feedforward compensator transmission 
matrix G may now be obtained: 


Gueersi hat (49) 


Since Fy, is diagonal, its inverse is simply a diagonal 
matrix whose elements are the reciprocals of those of 
Fy,. Consequently, from (48) and (49), G becomes 


G=(K+ 1)P F. (50) 
Similarly, from (37) and (38), 
H = F-' — F-'Fy, = FI — Fy, | 
K 
= ip (51) 
K+1 


Eqs. (50) and (51) are the design equations for the digi- 
tal compensators if the optimization criterion is the 


minimization of the performance function in (42). The 


corresponding sensitivity matrix for this design is 


1 
S=G(P41— PF = F-1P(P-! — P=))F 
K+1 


oa FAP — PCP INP NG 
eel [ (P + AP)-] 


1 
sees 


[J — FP(P + AP)“F]. (52) 


Note that for K large (Ni much more significant than 
No), (48) and (52) indicate that the elements of Fy, and 
S are inversely proportional (approximately) to K. 
This is in agreement with the previous section where 
the elements of S and Fy, may be made arbitrarily 
small if Ne is not important. Furthermore, if AP—0, 
then S approaches a null or zero matrix also, which 
should be as expected. 

The second criterion that is presented here is the 
minimization of the mean square of some error. Let 


Vi = Fix (53) 


represent the desired output column vector whose ele- 
ments are the desired outputs at the sampling instants, 
1.é., Ya(O), ya(T), ya(2T), - - - , vai NT —T), where Fy is 
the desired over-all transmission matrix defined previ- 
ously. Let E represent the difference between the ac- 
tual output and the desired output, 7.e., 


E=Y—-¥,. (54) 
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Then, if #’ is the transpose of F, 
N-1 

E'E = (V¥ — Va)'(Y — Va) = Do [y(AT) — yalRT)]?. (55) 
k=0 


Let the signal X, the noises N; and Ns, and the plant 
perturbation AP have random elements (AP here has a 
different meaning from that in the previous section). 
The random entries in AP may either represent errors in 
measurement or actual random fluctuations in the 
plant P. In order to have a meaningful performance 
function, some statistical operation must be performed 
on L’E. In particular, the performance function will be 
taken as the expected value of E’E with respect to X, 
INE. ING BN OGL ANIEZ 2 


C = ((((EE)x)w,)no)aP- (S6) 


The performance function in (56) is the same function 
which Fleischer!® applied to the continuous, linear, 
time-invariant case. The optimization problem is now 
clear: to choose G and H such that C in (56) is mini- 
mum. From (29) and (53), (55) becomes 


E'E = [F.X + Fy,Ni+ Fy,N2— FaX]’ 
-[FoX + Fy,Ni + Fy,N2 — FaX] (57) 
or 
E/E = X'(Fo — Fa)'(Fo — Fa)X + Ni'Fy,/Fy,N1 
+ No'Fy,'Fy,No+ X'(Fo — Fa)'(Fy,Ni + Fu,N2) 
+ (Ni'Fy,! + No! Fw,’) (Fe — Fa) X + Ni‘ Fy, Fn,N2 
+ N2’Fy,’Fy,™1, (58) 
where primes denote the transpose operation. It is as- 
sumed that the signal, the noises, and the plant pertur- 
bation are statistically independent so that the order of 
operation of taking expected values in (56) is of no con- 
sequence. It is further assumed that the elements of 1, 


Neo, and AP have zero mean. Let us investigate the 
individual terms in (58). For the first one, we have 


NE Phe ax 


Nis 


= > DS ena liT)2GD), 


i—0) 9 —0) 


(59) 


where the @j41,;41’s are the elements of the symmetric 
matrix (f2—Fa)'(F2— Fa). For convenience let us 
change indices in (59): 


x Fp Fr FX 


= >) >) ajeGT — T)x(GT — T). (60) 


t=1 j=1 


10 Pp, E. Fleischer, “Optimum Design of Passive-Adaptive Linear 
Feedback Systems with Varying Plants,” presented at the Joint 
Automatic Control Conference, M.I.T., Cambridge, Mass.; Sep- 
tember 7-9, 1960. 
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For the second term we have 


NN 


Nala aN = D5 sb GT — Tait — 7), 


i=1 j=1 


(61) 


where the 6,;’s are the elements of the symmetric ma- 
trix Fy,’ Fy,. Similarly, 


N N 
N2'Fy,'Fy,N2 = > Sy Cinoil a T)no(jT = aie 
i=1 j=1 


X'(F2 — Fa)'(Fy,Ni + Fy,N2) 
+ (Ni'Fy,’ + N2'Fy,')(F2 — Fa)X 


¥ a(iT — T) [djni(fT — T) + kyjna(GT — T)], (63) 


7s 


tt. 


z 


and 


Ni'Fy,'Fy,N2 + No Fy,/Fy.N1 
N N 
ae, 2! mil — T)n(jT —T), (64) 


where the elements c;;, dij, ki;, and 1;; have obvious 
meanings. Taking the expected value of E’E in (58) with 
respect to the x’s, m;’s, and 7's, 


re aN 


>» > a,(xGiT — T)x(jT — T)) 


<1 


(((E’E)x)w 2 = 


N 


+ 2) Do bikm(iT — T)m(5T — T)) 


where the rest of the terms drop out because the x’s, 
n;'s, and m’s are assumed to be independent and the n’s 
have zero means. Let the statistical autocorrelation 
functions of x, 7:1, and 2 be represented respectively by 


R.Gi, j) = (x(iT — T)x(jT — T)), (66) 
R,,(i,j) = (n(GiT — T)m(jT — T)), (67) 
Rra(i,j) ='(ne(iT — T)n2x(jT — T)). (68) 


Presently, all these functions are supposed to be given. 
Later on, it turns out that R,(7, 7) is not needed. The 
final step in determining the performance function is 
the statistical averaging of (65) with respect to the ran- 
dom fluctuations in AP: 


; N ON 
G= >) Dd) [MewarRilt, 7) + Ois)arRn(, 7) 


ey Sai 


+ (cis)a PRug(i, J) |. (69) 


Note that a;;, b;;, and ci; depend on the elements of AP 
which are assumed to be random. In particular, a;;, an 
~ element of the matrix (/2:—Fu)'(F2—Fa), is given by 


N 


Ss ae 


k=max (1,7) 


(fei ee Sui) (oft a “ran (70) 
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where 2fi; and afx; are elements of /, and Fy, respec- 


tively. Similarly, 
et 
bis = DY (nafs) (wr fe) (71) 
k=max (i,j) 
and 
N 
Hi DD sa Gary (72) 


k=max (1,7) 


The reason for starting the series from k=max (i, 7) is 
that F, Fy,, and Fy, are triangular matrices and the ne- 
glected terms are zero. Before the function C may be 
minimized with respect to the elements of G and H, 
the statistical quantities (ai;), (b:;), and (c;;) must be 
expressed in terms of the nominal values of g;; and hj;. 
In general, even for simple probability distributions of 
the elements in AP, the resulting expressions are quite 
complicated. For this reason, approximations will be 
used. From (33) F2 is 
F, =F + AF = (P+ AP)G|I + H(P + AP)G}-. (73) 
The perturbation AP will be neglected in the bracket so 
that 

F,= F+ AF= (P+ AP)GlI + HPG}". (74) 


This is equivalent to linearizing the dependence of AF 
on AP. Using (33), (74) may be written as 


= (P +°AP)P1F = (I + APP“) F 


=F + APPF. (75) 
This is equivalent to 
NN 
ofiy © fig + DL De bePrchess (76) 


Ki 71 


where 6,, is an element of AP and P;, is an element of 
P-', Hence, 


N 
ag > E a 


k=max (7,7) 


[a 


Assuming that the random plant perturbations dpq 
have zero mean, and assuming that 6,, is independent of 
dy, for r#n, then (a;;) simplifies to 


NON 
af ki <- ys De iuPafe | 


r=8 s=7 


ale ae > o Okn Paes (77) 


nm mj 


(ais) ae DE 
k=max (7,7) 
"oe DP ey 


m= s=i r=max (s,m) 


| (is = ads — fe) 


Ogee esr si ~| . (78) 


Similarly, for (b;;), an approximate form for the per- 
turbed Fy, will be used. Thus instead of 


Fy, = (F + AF)[(P + AP)G]3 (79) 
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from (38), we will neglect AP in the bracket and use 
only a linear approximation, 


Fy, ~ (F + AF)(PG) = (I+ APP-)F(PG) 


e (I APP By, (80) 
The pre-subscript 2 denotes the perturbed matrix. De- 
noting the elements of 2/y, by w,?f:; and those of Fy, by 
nv, fij, we have 


= Nils a > > Og E wey 8) (81) 


Wh G=7] 


ne hij 


so that (71) may now be approximated as 


N Nis AN 
b= DS (suf a ey, Ds BkrPrs vif) 
k=max (i,j) 


oes) 


(82) 


Nie iN: 
(safe =. DS orb, vfu 


nm mj 


and 


N 


(dis) = De 


k=max (7,7) 


= Ss S o (Spr?) P re Pym Nifsi mf): (83) 


r=max (1,j) s=t m=1 


(sf Nifki 


Using the same approximation as above for Fy, (41) 


yields 
ee APP Oy — Tf, (84) 


so that 


Nof: eo ya APT, Hine (85) 


7—s S—7) 


Neti ca 


and (c;;) is approximately 


N 


(ci) = Da; 


k=>max (7,j) 


| Gvsfes = Dlwifts — 2 


NN Sei 


a0 SD pe, Os ir”) PreP rm Nalae vitu : (86) 


T—s 8309, 


The approximations for (a;;), (b;;), and (c;:;) as given in 
(78), (83), and (86), respectively, are used for deter- 
mining the approximate form for C in (69). 

It should be noted that the performance function is a 
function of the unknown f;;’s and y,fi;’s, that is, the ele- 
ments of the nominal F and Fy, matrices. The other 
quantities in the expression for C are assumed to be 
known. It is clear that once the matrices F and Fy, are 
determined, G and H may be subsequently determined 
from (37) and (38). Let us proceed then to the mini- 
mization of C with respect to the f;,’s and y,fi;’s. Taking 
the partial derivative of C with respect to fp, and not- 
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ing that Kz) j) atts jeer 


2 D (foi 


k=max (j,q) r=max (m,p) m=j j=1 


+ afr) Rx(q J) eae 


(Sir?) PrpPrmfmpha(G,J) =9 forallp =1,2,--- WN 
Ge ole2 ae ay 
pq (87) 
or 
p N N N 
» Rg, 9) E he OS >s 
j=1 k=max (q,j) r=max (m,p) m=j 


5 (One prelim mj dn = (i) (88) 


It is desirable at this point to obtain a solution which 
is independent of input signal statistics. From (88), it is 
clear that if the R.(q, j7)’s are arbitrary constants, then 
the validity of (88) is guaranteed if we set the coeffi- 
cients of R,(q, 7) to zero for every j. Thus 


N N r 
ene: S, a me (Our?) Prpk emf mi = dfn; (89) 
k=max (7,j) r=max (m,p) m=7 
for 
DEA ae Ses 
j=A, 2, weave 
p>]. 


Note that & now starts at max (7, 7). The reason for this 


is that 6;, 1s zero for k>r. Hence we only need sum on 
k in (89) from k=max (gq, j, 7). Since 7 starts.from 
r=max (m, p) and since pq, then max (gq, j, r) =max 
(j, r). These N(N-+1)/2 linear equations yield the 
N(N-+1)/2 nonzero elements of F/. Fortunately, these 
N(N-+1)/2 equations are in the special form: one equa- 
tion in fyy, two equations in fy ,v-1, fy_1,v_1, three equa- 
tions in fy,w—2, fv-1,w—2, fy-2,v—-2, -* - and N equations 


in fw, fy-1, fn-2,1,°°°, fu. For example, setting 
p=N, and j=N in (89), yields 
fun + (6nn?)Pyn?fwn = afnn (90) 
or 
aly 
fvn = (91) 


1+ (Onn?) Pn? 
For p=N,y=N—1, 


In.w-1 ate (Onn?) Pyw(Pw,w—ifn—1,N-1 


+ Pywfn.w-1) = afy,n-1 (92) 
and for p=N—1, j=N-1, 
2 2 
fu—1w—a + [(8y—1,y—1) + Cara) |Pake he ae 
2 2 
+ (6vw)Py,w—ifn—1,y—1 + Snr Pa a ae 
= afn—1,N-1. 


(93) 
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The solutions for (92) and (93) are 


Fe eg ret Bien ye) on) Pana 
26. Al Ses OE een 
LEE Gren Pain) (1 Oxy ween) 
Pe eo Pywes}-? (94) 
and 
ee el en) Pun) 
— afv.n-a(6vw)Pw.waPww} { (1 + (Sxx) Pen) 
pr es on a) Ponca | 
Pe ey nett (95) 


Continuing in this manner the rest of the elements of F 
are determined. 

Similarly, taking the partial derivative of the per- 
formance function C with respect to y,fp, results in 


Pe hag) + 2D oy ear Ppl rm Nyfmi BGs) 


ee SLY Ore) Pp Prm W fap Ral Q9) 
+ 2) (xfer — 1)Rn(q, 7) = 0 (96) 
or 


[Rii(Q, j) ae Ris(Q, D| [wifi 


1 


Pp 
j= 


a De >) ye (Ser?) PrpP rm Ny a = ey KEG, Pen 
k room j=1 


fori p= 1, 2, ot oN Susy Dyet* ON spe 


The N(N+1)/2 unknown elements of Fy, are deter- 
mined from the N(N+1)/2 linear equations in (97). If 
it is assumed that noise occurring at different instants 
of time are independent or uncorrelated, then R,,(q, 7) 
and R,,,(q, j) are zero unless g=j. Hence (97) reduces to 


nif pa af ae ya ae, (kr?) PrpP rm Nifma 


k=r r=max (m,p) m=q 
KAGE 
rs (9 9) , (98) 
Rni(9, 9) + RnalG 


and the problem is similar to that in (89). That is, the 
N(N-+1)/2 equations separate into one equation in 
one unknown, two equations in two unknowns, and so 


on. 
With the F and Fy, matrices determined, (38) yields 
Ga Phy a8, (99) 

and from (38) and (39), = 
H = F- — F-1Fy, = FI — Fy]. (100) 
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Eqs. (99) and (100) are the final design equations. Note 
that these are the same design equations as obtained in 
(49) and (51) for the first performance function consid- 
ered. The difference is that Fy, and F are chosen dif- 
ferently. 

In the two performance criteria discussed above, ele- 
ments of the finite dimensional transmission matrices 
are involved. The instants of time corresponding to these 
elements are assumed to be in the future and in the 
present. Thus for the second performance function as 
given in (55) and (56), the mean of the sum of the 
squares of the predicted errors is involved. The instant 
t=0 corresponds to the present, 7 corresponds to the 
instant 7 units of time later compared to the present, 
and so on up to (V—1)7 units of time of prediction. 
The compensators are designed only to minimize errors 
at the present and in the future, not the past. 

Ideally, it is required that new data on P, Fy, AP, 
N,, and N2 will become available for subsequent ranges 
of prediction time. Thus it is envisioned that a sequence 
of matrices for G and H will be determined so that the 
digital compensators will be automatically resynthe- 
sized every NT time units. The synthesis for a specific 
range of N7 time units is on a short time basis which 
considers predicted errors in the P matrix by means of 
the AP specification, and also includes effects of noise 
disturbances. The new batches of data for succeeding 
ranges of predicting time in a way provide information 
on long-term changes in the nature of the plant, input 
signal, and noise. 


REALIZATION OF G AND Hf 


The transmission matrices G and H for the digital 
compensators may be realized by means of a digital 
computer. A model which is useful at least for visualiza- 
tion is a tapped delay line with time-varying gain ampli- 
fiers at the taps and an adder at the output.!!~-¥ An- 
other model, either for visualization or actual realiza- 
tion, is shown in Fig. 4. Both the tapped delay line and 
the model in Fig. 4 have finite memory. That is, 


h(iT, jT) =0 for i—-j>M, (101) 


where MT is the memory of the system. For many 
physical systems, the elements of the transmission 
matrix far away from the main diagonal are negligibly 
small so that (101) is a reasonable approximation. 

In Fig. 4, 7 is the sampling interval which is the dwell 
plus travel time for the rotating switches between adja- 


1 T. Kailath, “Sampling Models for Linear Time-Variant Filters,” 
Research Lab. of Electronics, M.I.T., Cambridge, Mass., Tech. 
Rept. No. 352; May 25, 1959. 

2 J. B. Cruz, Jr., “A generalization of the impulse train approxi- 
mation for time-varying linear system synthesis in the time domain,” 
IRE TRANS. oN Circuit THEORY, vol. CT-6, pp. 393-394; December, 
1959. 

183 J. B. Cruz, Jr., and M. E. Van Valkenburg, “The synthesis of 
models for time-varying linear systems,” Proc. Symp. on Active Net- 
works and Feedback Systems, Polytech. Inst. Brooklyn, Polytechnic 
Press, New York, N. Y., pp. 527-544; 1960. 
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Output 


Fig. 4—Model for finite memory digital compensator 


cent positions and M&M is the number of switch positions 
or contacts in each rotating switch. The zero-order hold 
circuits have a hold time of MT time units. The input 
resistors to the adder provide the various scale factors 
for the different elements h(i7T, 77) or g(@T, 77) of the 
transmission matrices. At the end of M7 time units, the 
resistor values are reset to new ones appropriate for the 
succeeding interval of MT units of time. The input- 
output transfer characteristic of the model in Fig. 4 is 


y(nT) = Ss h(nT, kT)x(kT). 


k=n—m 


(102) 


Although the model in Fig. 4 uses resistors for the ap- 
propriate weights for the corresponding elements in the 
transmission matrix, the actual. hardware will depend 
on the specific application. For large scale and exten- 
sive plants or processes, the digital computer may be the 
only feasible way. Here, storage or memory takes the 
place of the hold circuit. 


TIME-INVARIANT TRANSMISSION MATRICES 


The techniques described in this paper are valid 
whether the linear plant is time-varying or not. The 
method here differs from conventional ones using Z 
transforms in that the design is carried out entirely in 
the time domain directly, whereas, if Z transforms are 
used, specifications will usually have to be converted 
to the Z domain or some other “frequency” domain first. 
Note that for the truly time-invariant case, the opti- 
mization criteria discussed in the previous section re- 
late to the initial transient. This is because only the 
first NV sampling instants are involved. 

Another possible application is in the design of 
slowly time-varying adaptive systems. If the system 


IRE TRANSACTIONS ON AUTOMATIC CONTROL 


May 


variation is slow enough, the P, AP, Fa, and F matrices 
may be considered matrices for time-invariant systems. 
However, the predicted set of matrices for the next 
time duration of N samples may be different, so that 
the effect is a piece-wise or step-wise time-variation. 
This is active process adaptation. 


CONCLUSION 


The advantages of feedback in continuous control 
systems is well exploited. This does not seem to be the 
case for sampled-data systems. In this paper some 
methods of synthesizing the digital compensators in a 
time-varying system with two degrees of freedom have 
been presented. These compensators are designed not 
only to yield a desirable over-all input-output charac- 
teristic but also to minimize the effects of plant varia- 
tions, load disturbance, and instrument noise. The 
techniques are essentially the same for more degrees of 
freedom. 

The minimization for the second performance func- 
tion considered in the paper involved some approxima- 
tion. Consequently, the results are accurate only when 
the approximations are good enough. In particular, we 
assumed that the perturbation from the nominal pre- 
dicted plant transmission matrix is not too large. If 
this assumption is not justified, then higher-order terms 
must be included, resulting in nonlinear equations for 
the determination of the elements of the F and Fy, 
matrices. 

In the application to adaptive control, it is assumed 
that P is known or can be determined. That is, itis as- 
sumed that the so-called identification problem is 
solved. However, for time-varying plants, especially if 
the variation is not slow, it is extremely important 
that P must be for future values of time for the design 
to be meaningful. 
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Direct Cycle Nuclear Power Plant Stability Analysis’ 


D. BUDEN{ memper, IRE, AND R. F. MILLERTt 


Summary—A power plant with a heat exchanger such as a 
nuclear reactor substituted for the conventional chemical interburn- 
ers in a jet engine will cause a considerable change in dynamic per- 
formance. The instantaneous power generated by the heat source is 
not the same as the instantaneous power delivered to the turbine. 
The basic control problems are analyzed using fixed control param- 
eters and partial derivatives around a given operating point. A mathe- 
matical criterion is developed and correlated with power plant test 
data. 

An understanding of the inherent limitations of combining a re- 
actor, or any heat exchanger having a thermal lag, with a basic jet 
engine makes it possible to devise a means of control. The introduc- 
tion of an effective operational speed control makes it possible to 
operate a complete power plant under any desired condition. 


NOMENCLATURE 
Symbol 


A = Heat transfer area (inch?) 
As=Jet nozzle area (inch?) 
Cpa = Specific heat of air, constant pressure (BTU/ 
pound-°R) 
Cp = Specific heat of fuel elements, constant pressure 
(BT U/pound-°R) 
h=Film coefficient of heat transfer, fuel elements 
(BT U/inch?-sec-° R) 
M; = Mass of fuel elements (pound) 
N =Speed (rpm) 
QO, = Heat energy delivered to the air (Mw) 
QO,= Heat energy generated in the reactor (Mw) 
T, = Bulk air temperature (°R) 
T,; = Fuel element temperature (°R) 
T;= Reactor inlet air temperature (°R) 
T,= Reactor exit air temperature (°R) 
t= Time (seconds) 
W,= Reactor airflow (pound/second) 
W,,= Afterburner fuel flow (pound/hour) 
8=Compressor stator blades 
7 = Net torque (foot-pound) 
67 = Air temperature change across the reactor (°R) 


Note: Subscript zero denotes partial derivative evalu- 
ated at a point. 


I. INTRODUCTION 
eae the chemical interburners in a jet 


engine with a heat exchanger such as a nuclear 
reactor will cause a considerable change in the 
dynamic performance. No longer is the instantaneous 


* Received by the PGAC, October 26, 1960; revised manuscript 
received, March 23, 1961. 
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power generated by the heat source the same as the 
instantaneous power delivered to the turbine. The 
basic control problems can be analyzed assuming fixed 
control parameters and using partial derivatives at a 
given operating point. The results are correlated with 
test results by the General Electric Company during a 
heat transfer reactor experiment using modified J-47- 
GE-11 turbojet engines and a nonlinear analog power 
plant simulator. 

The analysis is used to examine various methods that 
can be used to control nuclear power plants. A proper 
selection of the control parameters will make possible 
operation at all desired engine speeds. 


II. REAcTOR-ENGINE STABILITY ANALYSIS 


A basic jet engine (assuming fixed control parameters) 
consists of a compressor section, burner section, turbine 
section, tailpipe and nozzle. The compressor is used to 
compress air drawn through the inlet to a high pressure 
level. In the burner section of a conventional jet engine, 
fuel is sprayed into the air and burned. The gas then 
passes through the turbine which is directly connected 
to the compressor. From here, the gas is ducted through 
the tailpipe to the nozzle, where it is accelerated and 
passes into the atmosphere. In a nuclear powered jet 
engine, the burner section is replaced or supplemented 
with a nuclear reactor. In the GE design, the air is 
heated by passing directly over the hot fuel elements. 
As in any heat exchanger, a certain thermal lag exists 
between the fuel elements and the air. This results in 
the instantaneous power generated by the reactor being 
different than the reactor power delivered to the air. 
Using conventional jet fuel, the energy is available to 
the engine as soon as it is burned. 

The thermodynamic relationships between the engine 
components and the reactor can be analyzed in terms of 
temperatures, airflows and speed. Such parameters as 
the jet nozzle and compressor stators are assumed to be 
fixed or stationary. 


N= Oe Wa, Ts] am B constant. (1) 


In terms of derivatives, the expression for the change 
in speed due to the actual power delivered to the air, 
considering this as the only variable, is 


dN 
= 70 


Since the power delivered to the air is a function of 
reactor power generated level, reactor inlet airflow and 


AN 


AQa. (2) 
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inlet temperatures, the change in power is given by 


AG = AAs —ai(\) 
00a 004 004 
KO el peer ae: e AT; (3) 
a0, AW. aT; 
Tae ke AQ (4) 
(PL ey AG 6 ae 
OT; OT: 
Mha = rh AN + — AG, (5) 
= g 


Substituting (3)—(5) into (2), 
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is the average, or bulk temperature of the air; and s is 
the Laplace operator. 
A second equation is 


heat added to air = heat lost by fuel elements 


CoaWdT = hA(T; — T,). (11) 


To derive relatively simple expressions, the assump- 
tion is made that the reactor can be considered to be a 
one-stage fuel element. More elaborate heat transfer 
studies, both digital and analog, which consider several 
fuel-element stages, have indicated that this approxima- 
tion is reasonably valid for the purpose at hand. 


[62) (2 
ANG ba aQ, AW. 


Mes) * (or) Go.) 


AQ, 


The various derivatives are a function of the particu- 
lar engine and reactor under consideration. 

Approximate expressions for the reactor heat trans- 
fer process can be derived which are suitable for use in 
hand calculations. The various approximations which 
are necessary will be indicated as they occur in the 
derivation. 

The heat energy delivered by the reactor to the air- 
stream is given by 


Qa = F (Cpa, Wa, 5T) = CpoW.ST, (7) 


where 67 is the temperature change across a given 
length of fuel element and c,, is the specific heat of the 
air. 
By assuming a constant specific heat, (7) can be lin- 
earized about an operating point. 
oF 


QO Jeet een iy (8) 
Ooh ys Alaa 


By using zero as a subscript on the variables to denote 
the partial derivatives evaluated at a point, (8) becomes 


AO, = CoaW aoAdT + CpdT AW, (9) 
where 
oF 
Fa sh ao} aW, = Cpad To. 


In order to investigate how the temperature change 
across the reactor varies, it is necessary to write the 
thermodynamic equations describing this behavior: 


heat generated = heat stored + heat lost 


QO = MycosTs{s) + KA(T; — Ta), (10) 


where M;, cps, 7y, and A refer to the mass, specific heat, 
surface temperature, and surface area, respectively, of 
the fuel elements; /# is the heat transfer coefficient; 7, 


dN a) so 
= (ios) Laine) Gare) + (Gre) (an 
dQa OW./ \ ON 0T;/ \ON 
With this approximation, 
temperature change 
= outlet temperature — inlet temperature 
bf = T,—T3. (12) 
The bulk temperature of the air is then 
T= try (13) 


The heat transfer coefficient can be approximated as 


h = KW,°? (14) 


Further details of the derivation are found in the 
Appendix. The change in temperature rise across the re- 
actor is given by 


1 M;Cos 
See emg gt 
CpaW ao Cpe ae 
iN gery see olay | ¢fiiee eines cay» 
i + T rs 1 + T rs 
On (1 0.2M;Coy ) 
AY 
Cpa Was? KA W ao 8 | 
=a AN) ee = ANS) 
1+ Trs iS 
where 
M jC py MjCys 
Tr = 
KA Wao? 2G xa Wias 


and the power delivered to the air stream is represented 
by 


1 
AQ. = —————- AQ, — MoS * 
(l +d Rs) (1 + Trs) 
ae AW. 
(1+ T;s) o (16) 


= Qo0 0.8M;Coy 
Wi. KAW,,°8 


M 7C pf 


Ke ‘ 
PANN OM 


The meaning of (15) and (16) is more clearly under- 
stood with a graphical interpretation as presented in 
leh 

Returning to (6) and using the partial derivative ex- 
pressions derived for the reactor with the characteristic 
expressions for a jet engine, 


OQ. ¥ 1 OW, - 
AVG ule ae ey gre 02 See 
dN Ke 2 ; OT; 3 
== > a eC 
eT ee 0, ; 
00. Kes OT: 
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OW. 
= Ky, Kyw > 0) 
oN 
00. — Kis 
OT; 1-+ Trs 
K, = M Coz 
AN 
AQ, 
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= : (17) 
Teles? + (Te+Tret+ KekiKr— KekKaKq)s +1. 


The system will be stable if both roots of the denom- 
inator are negative or have negative real parts. For this 
to occur, the following inequality exists: 


Te+Tz+ KiKrKz — KekKwkK. > 0. (18) 


This criterion can be used to test the stability of in- 
troducing any type of heat exchanger into a jet engine. 


III. Stapriity TESTING OF THE HEAT TRANSFER 
REACTOR EXPERIMENT-3 (HTRE-3) POWER PLANT 


The GE Heat Transfer Reactor Experiment-3 
power plant was used to test the criterion developed in 
(18). The HTRE-3 power plant consists of two X-39-5 
turbojet engines to provide cooling airflow for the nu- 
clear reactor. Each engine can operate using either en- 

ergy from the reactor or from a chemical fuel combus- 
tion system. The X-39-5 engine is a major modification 
of the J-47-GE-11 turbojet engine. The engine has been 
modified by removal of the combustion section and ad- 
dition of a compressor discharge scroll, which collects 
compressor discharge air for ducting to the reactor; and 
turbine scroll, which takes the hot air from the reactor 
and/or chemical combustor and distributes it to the 
turbine inlet annulus. Other major changes include re- 
duction of compressor flow capacity to obtain a suitable 
match between the compressor and turbine and installa- 
tion of a new engine control system. The characteristics 


Step in power generated, Q P 
g 
We i T3 = Constant 


Step in airflow 


= constant 


Wai Qo TT; 


Step in reactor inlet temperature, T3i Q_,W_ = constant 
g’ a 


Fig. 1—Effect of varying inlet conditions to the reactor. 


curves are typical for a jet engine taking the form shown 
inhigy2: 

Data were obtained from the simulated and actual 
power plants for use in testing the stability criteria de- 
veloped in (18), where for 


Tea Tg +, WjKrkg — Keak wk > 


the power plant will be stable. These data are tabulated 
in Table I. Various speeds are checked with (18) and 
the results are given in Table II. It is seen that the 
stability criteria indicates that the power plant should 
be stable at 6000 rpm and above, but will be unstable 
at 5500 rpm and below. Of course, this is still assuming 
all fixed control parameters, except for varying the re- 
actor power level. 

In January, 1960, a test of the HTRE-3 power plant 
was performed at the GE Idaho Test Facility in 
order to check the correctness of the analysis. The power 
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Fig. 2—Steady-state operating characteristics curves 
for a jet engine. 
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(Fig. 3). In Fig. 4, 1 per cent power reductions were 
made starting at 6000 rpm. Above 5900 rpm, the power 
to air follows the power generated from one operat- 
ing point to the next, but with a certain time lag. 
The time lag is the result of the large mass of material in 
the reactor and the stored thermal energy that must be 
transferred from the core to the airstream to achieve 
the new lower turbine inlet temperature. Below 5800 
rpm, a decrease in speed requires an increase in tempera- 
ture for steady-state operation. When power is reduced 
below 5900 rpm, the temperature starts to decrease, 
with the resultant decrease in speed and mass flow. The 
decreasing mass flow tends to raise air temperature to 
the new operating point requirements, but this requires 
an increase in reactor core temperatures. To increase the 
core temperature requires considerable energy and this 
amount of energy is therefore not available to the air- 
stream. As a result, the power to the airstream de- 
creases, and since the engine cycle operates on Q, rather 


TABLE 1 
HTRE-3 Power PLANT DATA 
Se Ky Kr Kr Kw 
Speed Airflow poate Tr Tr mw mw “Uke rpm #/sec 
ower 
(rpm) (No. /sec) (Mw) (sec) (sec) —— 
W. No. /sec Hk rpm mw rpm 
7000 117 Bova th WSS) 3 Epa y Ont7 0.070 245 0.014 
6500 108 De 13.4 4 2.70 0.17 0.065 245 0.019 
6000 97 OS) 15.0 7 Sul Os aly) 0.065 245 0.026 
5500 82 dif 1a 11 3.84 Only 0.060 345 0.032 
5000 65 16.5 2253 14 5.66 OI 0.060 500 0.032 
TABLE II than power generated, the further decrease in speed 
STABILITY FUNCTIONS produces an even greater temperature deficiency. Thus, 
SF = Tr-+ Te + KoKrKn — KeKoKs the cycle is unstable below 5800 rpm and confirms the 
analytical stability analysis. 
Speed SF Remarks Another way of understanding the stability of the 
7000 1.6.8 Stable operating point power plant with the reactor is to look at the speed-en- 
6500 407-5 Stable operating point ergy balance relationships that exist. The characteristic 
6000 Sa) Stable operating point for AT REZ 1S clotted Gn ies oe thy lid Ii 
5500 —10.2 Unstable operating point OF 1S plotted im Mig. o. € solid line repre- 
5000 —49.2 Unstable operating point — sents the energy required to maintain steady operation 


plant was successfully operated at a speed of 6000 rpm 
ona fixed reactor power. When power was stepped down 
to approximately the value required for 5500 rpm, 
speed dropped off rapidly. The reactor then had to be 
shut down so that no damage would occur to the power 
plant. : 

To understand further the stability of the cycle, the 
HTRE-3 was simulated on the analog computer. This 
simulation indicated that under the conditions imposed, 
the power plant is stable above 5800 to 5900 rpm. Traces 
of this are reproduced in Figs. 3 and 4. 

Examining these figures closely, the relationship. of 
power generated by the reactor and the power actually 
delivered to the airstream is seen. The power to the air is 
computed by Q,=W.C,AT. The simulator was _ ini- 
tially operated at 100 per cent speed, with a fixed jet 
nozzle and successive power reductions of 5 per cent 


at a given speed. If an energy-speed point is above the 
line, the power plant will accelerate with deceleration 
occurring below the line. 

The energy map is subdivided into four areas using 
the speed line through the reversal point and the power 
curves as the boundary lines. Each of these areas will be 
examined separately for stability. 

First, examining Area I, if it is a chemical inter- 
burner system, the power delivered to the air always is 
exactly proportional to fuel flow. Now assume a small 
perturbation from the steady-state operation line that 
would increase speed into Area I. The higher speed 
would result in increased airflow, since 


dW. 
dt dt 


where K is always positive. Fuel flow is fixed and thus 
the energy per unit flow drops. The energy is not suffi- 
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Fig. 3—HTRE-3 power reductions in 5 per cent steps from 7950 
rpm, 5000 foot, Standard Day operating conditions, jet nozzle 
area fixed. The difference between power generated and power 
delivered to the air stream is shown. Also indicated is the relation- 
ship between speed and power generated. The rapid drop-off in 
speed is seen below 6000 rpm. 


‘Fig. 4—HTRE-3 power reductions in 1 per cent steps from 6000 
rpm, 5000 foot, Standard Day operating conditions, jet nozzle 
area fixed. Transition from the stable operating region is shown. 


cient to maintain the supposed increase in speed and 
the cycle returns to the original steady-state operating 
point. 

Inserting the reactor in place of the chemical burner, 
the power generated is the same as the power delivered 
to the air cycle only during steady-state operation, but 
unlike the chemical system where fuel flow always is 
_ assumed proportional to Q,, a large thermal lag exists 
between Q, and Q, during transients. With the assump- 
tion of a disturbance that increases speed, air flow will 
increase. Since 


AQa 
A Wa 


es —t/T, 
= Kye ITR, 


? part of the stored energy from the reactor will initially 
go into the engine cycle. Thus, Q./W, does not decrease 
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Fig. 5—Power vs speed curves for HTRE-3. 


crease in speed and the cycle is therefore stable on nu- 
clear power in Area I. 

Turning to Area II, hypothesize once again an in- 
crease in speed during chemical operation. As speed in- 
creases, the energy per unit flow decreases and with a 
fixed fuel flow, the increase in airflow will cause W;/W. 
to decrease. However, looking at the power-speed curve 
it is seen that an increase of fuel flow is required to 
maintain the new speed, but under the assumption of 
fixed fuel flow, increased power is not available. There- 
fore, speed must return to the original operating point. 

When the nuclear system is examined, the situation 
is different. The assumed perturbation increasing speed 
will require a lower energy per unit flow. Recall that 
the energy delivered to the engine cycle is now a va;ci- 
able. The greater airflow causes the energy delivered 
to the cycle by the reactor to increase, but the quantity 
Q./W, decreases. The additional power required to 
maintain the higher speed is temporarily available. 
Eventually, the borrowed stored energy will not be 
sufficient to maintain the increased speed and, there- 
fore, speed will drop. When the original starting point 
is approached, however, there is a deficiency in energy 
available to maintain the operating point and speed 
drops still further. Thus, the cycle is unstable in Area IT. 

Examination of Area III indicates the same conclu- 
sions would be reached as in Area II witha stable chemi- 


cal interburner, but unstable on the nuclear reactor. 
Area IV proves to be stable on both chemical and nu- 
clear power. 


~ as much as a chemical fuel system where Q, is fixed, but 
it will still decrease. Therefore, the energy per unit 
_ flow is not available to maintain’ the hypothesized in-- 
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IV. 


In previous sections, it has been shown that a nuclear 
power plant such as HTRE-3 is stable in the upper op- 
erating speed range but unstable below this. There are 
two basic methods available to stabilize the system and 
extend the operating range of the power plant. The 
first method is to eliminate the positive feedback loop. 
The second is to build an automatic feedback control 
loop around the positive feedback loop such that the 
over-all system, or exterior loop, is stable. 


INVESTIGATION OF CONTROL METHODS 


A. Elimination of the Positive Feedback Loop 


The stability criteria developed in Section II stated 
that for the power plant to be stable the following in- 
equality exists: 


ie inh okie — Kek yk, > 0. 


Thus, since Kz, Kw, K, are the gain terms associated 
with the derivatives of 


oN 

IQ. 
if any of these terms are zero, the system will be stable. 
Also, the loop can be made stable if any one or any 
combination of the three can be sufficiently reduced in 
magnitude. Therefore, a more detailed examination of 
the partial derivatives is in order. 

1) Discussion of 0N/OQ,: In order to prevent speed 
from changing with a small change in power to the air, 
it is necessary to control some parameter in the power 
plant in such a manner that a desired speed can be 
maintained. This might be done, for instance, by a vari- 
able jet nozzle. Fig. 6 is a typical control parameter map. 
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Fig. 6—Control parameter map. 
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The solid curves are plots of reactor exit air temperature 
vs reactor power for constant nozzle area, where the 
reactor power refers to the energy into the air stream. 
The dashed line curves are plots of reactor exit tem- 
perature vs reactor power for constant speed conditions. 
Since the stability criteria is based on a fixed nozzle, 
which is represented by the solid lines, it is of interest to 
examine the dashed line. The slope of these lines is al- 
ways positive and thus, if the nozzle can be controlled 
to maintain a fixed speed, 0VV/0Q, can be reduced to 
zero and the power plant will be stable. 

Other methods besides a variable jet nozzle can be 
used to fix speed around the operating point, but the 
important thing is that if a parameter is found to con- 
trol speed, the power plant will be stable. 

2) Discussion of OW./0N: The partial derivative 
OW./ON is determined by the variable geometry of the 
compressor. The use of an automatic control of the 
compressor stator blades results in relatively large 
changes in airflow with changes in speed over the op- 
erating range. Fig. 7 shows the relationship of airflow 
to speed at approximately the scheduled operating 
point. On the other hand, if the stator levers are con- 
trolled by the operator, that is, fixed at each operating 
point according to some predetermined schedule, the 
change in airflow with speed about the operating point 
is relatively small. 

An analog computer simulation of a jet engine was 
arranged so that the compressor airflow was completely 
independent of speed around an operating point. Ad- 
mittedly, this was a most optimistic assumption, but it 
was used as a starting point. The engine cycle was un- 
stable as speed was lowered as a result of power cycle 
efficiency. At high operating speed, if the airflow is held 
constant, the amount of power supplied by the reactor 
must be increased to reach a higher speed. However, 
around a lower operating speed, less power is needed to 
obtain a higher speed. 

A reactor exit temperature control is not a satisfac- 
tory method of controlling the engine cycle in the lower 
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Fig. 7—HTRE-3 approximate airflow vs speed curve. 
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operating range even with airflow independent of speed 
because of poorer cycle efficiencies. Difficulties were en- 
countered in the use of an automatic power level control 
because of the tendency for flux to be a multivalued 
function of speed, if not restricted to a narrow range. 
The engine would tend to go to the higher operating 
point. Therefore, it was concluded that reducing 
dW./0N was not a feasible solution toward stabilizing 
the power plant. 

3) Discussion of 0Q./0W.: The third partial deriva- 
tive, 0Q,/0W., is determined by the heat transfer char- 
acteristics of the reactor. This is a function of the re- 
actor, and in particular a function of the core design. 
Reducing the time constant of the reactor would reduce 
this term. This fact was verified with the analog power- 
plant simulation; reducing the time constant sufficiently 
permitted operation as desired. However, since the 
prospect of faster heat transfer from the reactor is not 
immediately foreseeable, this did not offer a practical 
method of stabilizing the power plant. 


B. Addition of External Engine-Reactor Feedback Paths 


It is noted in previous sections that changes in speed 
also change the instantaneous heat energy delivered to 
the turbines. Referring to Fig. 8, it is seen that if either 
AQ,2 or AQ,3 changes, AQ.1 must be made to change in 
the opposite directions. This requires a change in AQ,, 
and since 0Q,/0Q, represents a lag, the signal to cause 
the change in AQ, must be an anticipating signal. One 
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Fig. 8—Nuclear system transfer function block diagram. 
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such signal is the acceleration of the turbine rotor, ob- 
tained either from an accelerometer on the rotor or by 
differentiation of the engine speed. In theory, then, it 
should be possible to stabilize the system by putting 
the rate of change of speed into the flux loop as an addi- 
tional negative feedback signal. 

The practicability of the solution is another matter. 
Not indicated in the above discussion is the effect that 
the rate feedback will have as far as noise is concerned. 
Also, the system is linearized for operation around a 
point. Differentiation of signals is generally avoided in 
control systems as much as possible because of the noise 
problem. Another aspect is the physical feasibility of 
obtaining the rate signal. 

The rate feedback was introduced into the analog 
power plant simulator by differentiating the speed sig- 
nal. A lag was also incorporated into the feedback cir- 
cuit since a lag would be encountered in the physical 
system. It was found that the speed range could be in- 
creased by this means of stabilization. However, the 
noise associated with the differentiator was found to 
keep the reactor control rods in continuous motion. In 
fact, the noise was such that the rods failed to reset 
themselves properly. It is therefore doubtful that this 
means of stabilization would be useful in a practical 
system. 

The development of a speed loop in which engine 
speed is controlled by reactor power was also consid- 
ered. This could be accomplished by introduction of a 
lead network as a forward element of the speed loop in 
front of the flux loop. This method of stabilizing the 
power plant offered little encouragement. 

The thermodynamic cycle of the engine was studied 
for other possible methods of stabilization. One possi- 
bility from the cycle is the use of the pressure drop 
across the turbine P4/Ps;, the pressure drop being pro- 
portional to [1+K(dN/dt)]. Unfortunately, the lead 
action is not sufficient to stabilize the system and was 
thus dropped from further consideration. 

The introduction of an external engine-reactor feed- 
back path can be used to stabilize the power plant in the 
form of a speed derivative. However, the noise problem 
associated with the system would be difficult to solve 
with physical hardware. Various methods for stabilizing 
the power plant are summarized in Table III. 


TABLE III 
SUMMARY OF POWER PLANT STABILITY INVESTIGATION 


Stators Nozzle Reactor Remarks 
i Fixed Flux or temperature control Stable operation above the inflection point in the 73.9. vs Qa 
even é x curve. Unstable below the inflection point due to engine- 
reactor characteristics. 

Fixed (assume Wz in-.| Fixed Flux or temperature control Unstable at lower speeds because of compressor character- 
ndent of NV. istics. . j 
etue, Automatic | Flux or temperature control Stable operation over entire range as long as speed loop is 

ee dominant. : 
Variable Fixed Flux control with rate feedback of speed | Stable over operating range, but very noisy reactor operation. 
Fixed Automatic | Flux control Stable operation around fixed schedule. 
Variable © Fixed Flux control with speed over-ride Unstable at lower end of operating range. __ : 
Variable Unstable from initial evaluation because of insufficient lead 


Fixed 
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V. CONCLUSIONS 


A mathematical relationship has been developed for 
power plants consisting of a jet engine with a heat ex- 
changer for the power source that can be used to test the 
stability of such power plants knowing certain partial 
derivatives. The criterion is based on the assumption 
that the power level of the heat exchanger can be regu- 
lated with all other control parameters being fixed. A 
test on the HTRE-3 power plant developed by the GE 
Aircraft Nuclear Propulsion Department indicates the 
correctness of the analysis. 

No difficulty is encountered in operation in the re- 
stricted upper-speed region. However, in order to 
achieve a low idle thrust, it is desirable to extend the 
speed operating range. Once the effects of inserting a 
nuclear reactor into the jet engine are understood it is 
possible to develop power-plant controls to achieve 
any desired type of operation. 

Methods of extending the operating region were in- 
vestigated, and it was determined that the use of a high- 
response speed-control system offered the best possi- 
bility for achieving the extended operating region. With 
the speed control it is possible to achieve any desired 
operation with the nuclear power plant. 


APPENDIX 


Eqs. (15) and (16) are derived by linearizing the re- 


arranged equations of Section II and evaluating the ~ 


partial derivatives at a given point. 
Substituting (11) and (13) into (10), (19) is obtained: 


M jC ps5 T 


& eel eT ce 
hA 
“Cpa gOd 


O; S + M jCpyT 38 


(19) 
Combining (14) and (19), and re-arranging, the fol- 
lowing is obtained: 
Qs — MycpsT 35 
M pCofCoaW 2°? i 
KA 
G(Q,, a W.). 


6T = 


(20) 


Eq. (20) may be linearized about an operating point 
to obtain AéT: 


re es Nenee Sete staan (21) 
© Giger S| ae eae 


The partial derivatives are obtained from (19). The 
subscript zero is again used to denote that the partial 
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derivatives are evaluated at a point. After simplifica- 
tion, the results of the differentiation are: 


1 
0G eG 
00 i Myc Myc 
Qu ( LOpf 4 Spf )s 4 
KA Wiggs gps Wao 
ae M jCps ‘ 
OG Goal) as 
oT: xt Myc M jc 
3 ( iy ed )s 44 
KA Vee Doms W ao 
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OW. Myc M jC 
( {0 asain eae )s aA 
KAW ae Dene ae 
To simplify the notation, we set 
M jepy MsCpy 
KAW a * D2eeWes 


= Tp. 


Eq. (21), with the evaluated partial derivatives, be- 
comes 


1 M sCpz 
by 
Cpa W so Goa xe 
BT === A0, = = AT 
(1 + Trs) (1 + Trs) 
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The value of A6T obtained from (15) can now be sub- 
stituted into (9) with the following results: 


1 Mycpss 
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Japan, on April 4, 1934. He received the 
B.S.E.E. degree in 1956 from Illinois Insti- 

tute of Technology, 
-Chicago, and _ the 
M.S. and Ph.D. de- 
grees in 1959 and 
1961, respectively, 
from Northwestern 
University, Evans- 
ton, Ill. 

He worked for 
Sperry | Gyroscope 
Company, Great 
Neck, N: Y., from 
1956 to 1957. 

: = Dr. Sahara is a 
member of Eta Kappa Nu, Tau Beta Pi, 
and Sigma Xi. ; 
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Otto J. M. Smith (M’44-SM’51-F’59) 
was born in Urbana, Ill. on August 6, 1917. 
He received the B.S. degree in chemistry 
from Oklahoma Agri- 
cultural and Mechan- 
ical College, Still- 
water, and the 
B.S.E.E. degree from 
the University of Ok- 
lahoma, Norman in 
1938. He was a re- 
search assistant at 
the H. G. Ryan High 
Voltage Laboratory 
at Stanford Univer- 
sity, Stanford, Calif., 
from 1938 until 1941, 
when he received the Ph.D. degree in elec- 
trical engineering. 

He has taught and conducted research at 
Tufts College, Medford, Mass., Doble Engi- 
neering Company, Medford, Mass., Denver 
University, Colo., Westinghouse Research 
Laboratory, Summit Research and Develop- 
ment Laboratory, Scranton, Pa., Shell Devel- 
opment Company, Emeryville, Calif., Radio 
Interference Specialty Company, San Fran- 
cisco, Calif.,and Donner Scientific Company, 
Concord, Calif. He has been at the Univer- 
sity of California in Berkeley since 1947. 
From 1954 to 1956, while on leave from the 
University of California, he was a visiting 
professor of servomechanisms at the Insti- 
tuto Tecnologico de Aeronautica, Sao Jose 
dos Campos, Estado de Sao Paulo, Brazil. 
He studied the educational system of Brazil, 
made recommendations, and taught ad- 
vanced automatic control systems for the 
Brazilian government. As a Guggenheim 
Fellow in 1960, he conducted research at the 
Institut fiir Regelungstechnic, Technische 
Hochschule Darmstadt, West Germany, and 
traveled extensively in Russia. He was a 
member of the American Automatic Control 
Council inspection team for the Japanese 
Government in May, 1961. He is presently 
a professor of electrical engineering at the 
University of California in Berkeley. 

He is the inventor of a low-frequency 
sine-function generator, an X-ray thickness 
gauge, low-frequency test equipment, dead- 
beat predictor controls for automatic sys- 
tems, a constant-frequency variable-speed 
generator, a controlled-torque ac motor, 
and a phase-shift scaler. He has published 
research in the fields of magnetic amplifiers, 
magnetic frequency multipliers, semicon- 
ductors, phonograph recording, high-voltage 
corona, power-line fault locators, radiation 
instrumentation, counters, education, eco- 
nomic analogs, nonlinear feedback systems, 
machinery and statistics. 

Dr. Smith is a Fellow of the AAAS, and 
a member of the AIEE, the ASEE, American 
Automatic Control Council, American Phys- 
ical Society, American Institute of Physics, 
Sigma Xi, Phi Kappa Phi, Tau Beta Pi, 
Eta Kappa Nu, Phi Lambda Upsilon, Alpha 
Phi Omega, Kappa Tau Pi, and Phi Eta 
Sigma. 
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Richard K. Smyth (A’52—M’57) was 
born in Ada, Okla., on August 30, 1929. He 
received the B.S. degree in physics from 
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the California Institute of Technology, Pasa- 
dena, in 1951. In 1958, he received the 
M.S.E.E. degree from the University of 
Southern California, 
Los Angeles, where 
he is presently a can- 
didate for a Ph.D. 
degree in electrical 
engineering, special- 
izing in servo theory, 
computers, circuits 
and mathematics. 

From 1951 to 
1955, he worked at 
Statham Laborator- 
ies, Los Angeles, and 
for Wiancko Engi- 
neering Company, Pasadena, in the field 
of dynamic instrumentation and electron- 
ics. He joined Autonetics, a division of 
North American Aviation, Inc., Downey, 
Calif., in 1955 and has successively held the 
positions of research engineer, senior re- 
search engineer, and engineering supervisor 
in the Armament and Flight Control Engi- 
neering Division. He has worked in the area 
of synthesis and analysis of advanced flight, 
control systems and landing systems for 
vehicles such as the F-107, F-108, B-70, A3J, 
GAM-77A, NAVAHO, F-102, and DYNA 
SOAR. 

Mr. Smyth is a lecturer in circuit syn- 
thesis and electromechanics in the electrical 
engineering department at the University 
of Southern California. 
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William H. Surber, Jr., (M’47) was born 
in Charlottesville, Va., on April 14, 1920. 
He received the B.S. degree from the Uni- 
versity of Richmond, 
Richmond, Va., in 
1941. He received the 
E.E. degree in 1943, 
and the Ph.D. degree 
in electrical engineer- 
ing in 1948, from 
Princeton University 
Princeton, N. J. 

From 1944 to 
1946, he served in the 
US Sy NeAY BS 2 
member of the Elec- 
tronic Field Service 
Group at the Naval Research Laboratory in 
Washington, D. C. In 1948, he was ap- 
pointed an assistant professor at Princeton 
University, and he became an associate pro- 
fessor in 1951. He has been a professor of 
electrical engineering since 1956. 

He has been a consultant to the Brook- 
haven National Laboratory, Upton, N. Y., to 
the Electronics Division of the Curtiss- 
Wright Corporation, Carlstadt, N. Y., for 
the development of aircraft simulators and 
analog computing systems, and to a number 
of other companies in the fields of electronic 
circuits and feedback control systems. At 
present he is a senior consultant and director 
of the Aeronautical Research Associates of 
Princeton, Inc., for work in the area of 
adaptive control systems. 

Dr. Surber is a member of Phi Beta 
Kappa Sigma Xi, the AIEE, and the Ameri- 
can Physical Society. 
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Albert I. Talkin (A’50—M’55) was born 
in Brooklyn, N. Y., on January 3, 1924. He 
received the B.A. degree in physics from 
Brooklyn College in 
1944, and the M.A. 
degree in mathemat- 
ics from Columbia 
University, New York, 
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From 1944-1946, 
he served as an army 
electronics technician 
on the Manhattan 
Project, Los Alamos, 
N. M. In 1947, he 
joined the Rotating 
Physics Program at 
General Electric Company, Schenectady, 
N. Y., where, from 1948-1950, he did circuit 
design work in the receiving tube depart- 
ment. From 1950 to 1953, he was with the Na- 
tional Bureau of Standards, Washington, 
D. C. He became a member of the Diamond 
Ordnance Fuze Laboratories, Washington, 
D. C., at its activation in 1953. His major 
experience has been in circuit design and 
feedback control, and at present he is Re- 
search Supervisor in the Countermeasures 
and Special Systems Branch. 
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Franz B. Tuteur (S’49-A’51—M’56) was 
born in Frankfurt-am-Main, Germany, on 
March 6, 1923. He received the B.S. degree 
from the University 
of Colorado, Boulder, 
in 1944, and the M.E. 
and Ph.D. degrees 
from Yale Univer- 
sity, New Haven, 
Conn., in 1949 and 
1954, respectively, all 
in electrical engineer- 
ing. Since 1950 he has 
been a full-time staff 
member at the Elec- 
trical Engineering 
Department of Yale 
and currently holds the rank of Associate 
Professor. His major fields of interest are in 
servomechanisms and in communications 
theory, and he has been active in a number 
of research projects in these fields. He is co- 
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author of the textbook “Control System 
Components.” 

Dr. Tuteur is a member of Tau Beta Pi, 
Sigma Xi, and Eta Kappa Nu. 


Gerald E. Tutt was born in Richmond, 

Va., on April 6, 1935. He received the B.S. 
degree in mechanical engineering from the 
University of Cali- 
fornia, Berkeley, in 
1958, and has com- 
pleted work towards 
the M.S. degree in 
mechanical engineer- 
ing at the University 
of Southern Califor- 
nia, Los Angeles. 
In 1958, he joined 
ia the Douglas Aircraft 
Company, Santa 
Monica, Calif., where 
he worked on the 
engine servo analysis of the Able II second 
stage. Subsequently, his duties involved the 
control system analysis of the Able III and 
IV first stage, and the Transit-Courier first 
stage. From June-September, 1960, he 
served as the Douglas Guidance and Con- 
trol Section representative at Vandenburg 
Air Force Base, Santa Maria, Calif. In this 
capacity, he assisted with the autopilot 
checkout and the preliminary flight analysis 
of the Discoverer space vehicle. At present, 
he has been investigating control tech- 
niques for flexible vehicles. 

Mr. Tutt is a member of the ASME. 
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Walter K. Waymeyer (M’60) was born 
in Covington, Ky., on August 20, 1927. 
He received the B.S.M.E. degree from 
the University of Cincinnati, Cincinnati 
Ohio, and the M.S.M.E. degree from the 
University of Kansas, Lawrence, in 1949 
and 1951, respectively. Since then he has 
studied electronics and automatic control at 
Cornell University, Ithaca, N. Y., New 
Mexico State University, University Park, 
and the University of California at Los 
Angeles. 


In 1951, as a lieutenant in the U. S. 
Army Ordnance, he was assigned to the 
White Sands Missile Range, White Sands, 
N. M., where he be- 
came associated with 
the development and 
testing of guided 
missile control sys- 
tems. In 1954, he 
joined the Douglas 
Aircraft Company, 
Santa Monica, Calif., 
where he has had 
control design  re- 
sponsibility in the 
Nike, Thor, Skybolt 
and Saturn  pro- 
grams. Since 1959, he has held his present 
position as Supervisor of the Control Group. 

Mr. Waymeyer is a member of Pi Tau 
Sigma and Tau Beta Pi. 
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Cornelius N. Weygandt was born in 
Germantown, Pa., on August 13, 1904. He 
received the B.S.E.E. degree from the Moore 
School of Electrical 
Engineering, Uni- 
versity of Pennsyl- 
vania, Philadelphia, 
in 1928, the M.S.E.E. 
degree from the 
Massachusetts Insti- 
tute of Technology, 
Cambridge, in 1933, 
and the Ph.D. from 
the Moore School, in 
1937. 

From) | 1928 ito 
1932, he was em- 
ployed in various departments of the Gen- 
eral Electric Company, and for two years 
thereafter, he was with the Brooke Engineer- 
ing Company, Philadelphia. He then joined 
the staff of the Moore School, where he is 
presently Professor of Electrical Engineer- 
ing, teaching courses in Energy Conversion 
and in Control Instrumentation. 


C. N. WEYGANDT 


*, 
ef 


Jack Wing (S’51—A’52—M’57), for a pho- 
tograph and biography, please see page 94 
of the February, 1961, issue of these TRANs- 
ACTIONS. 


